-- Logs begin at Wed 2022-08-24 16:56:58 UTC, end at Wed 2022-08-24 18:10:44 UTC. -- Aug 24 17:40:22.149364 dv-cinder-854428-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 17:40:22.159174 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 17:40:22.161042 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 17:40:22 2022] *** Aug 24 17:40:22.161042 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 17:40:22.161042 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 17:40:22.161042 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: nodename: dv-cinder-854428-1-iscsi Aug 24 17:40:22.161042 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: machine: x86_64 Aug 24 17:40:22.161042 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: clock source: unix Aug 24 17:40:22.161042 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: pcre jit disabled Aug 24 17:40:22.161042 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: detected number of CPU cores: 4 Aug 24 17:40:22.161042 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: current working directory: / Aug 24 17:40:22.161042 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: detected binary path: /usr/bin/uwsgi-core Aug 24 17:40:22.161712 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: your processes number limit is 47680 Aug 24 17:40:22.161712 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: your memory page size is 4096 bytes Aug 24 17:40:22.161712 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: detected max file descriptor number: 2048 Aug 24 17:40:22.161712 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: lock engine: pthread robust mutexes Aug 24 17:40:22.161712 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: thunder lock: enabled Aug 24 17:40:22.161712 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 17:40:22.161712 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 17:40:22.200639 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: Python main interpreter initialized at 0x557f1cb7c9c0 Aug 24 17:40:22.200639 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: python threads support enabled Aug 24 17:40:22.200639 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: your server socket listen backlog is limited to 100 connections Aug 24 17:40:22.200639 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: your mercy for graceful operations on workers is 90 seconds Aug 24 17:40:22.200977 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 17:40:22.200977 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: *** Operational MODE: preforking *** Aug 24 17:40:22.201255 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: *** uWSGI is running in multiple interpreter mode *** Aug 24 17:40:22.201255 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: spawned uWSGI master process (pid: 112624) Aug 24 17:40:22.201498 dv-cinder-854428-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 17:40:22.202560 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: spawned uWSGI worker 1 (pid: 112625, cores: 1) Aug 24 17:40:22.202560 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: spawned uWSGI worker 2 (pid: 112626, cores: 1) Aug 24 17:40:22.202560 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 17:40:22.873831 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 17:40:22.874529 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 17:40:23.973973 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:40:23.973973 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: from cryptography.utils import int_from_bytes Aug 24 17:40:23.974727 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:40:23.974727 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: from cryptography.utils import int_from_bytes Aug 24 17:40:23.975149 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:40:23.975149 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: from cryptography.utils import int_from_bytes Aug 24 17:40:23.975265 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:40:23.975265 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: from cryptography.utils import int_from_bytes Aug 24 17:40:26.512998 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 17:40:26.513565 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 17:40:26.513767 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 17:40:26.514152 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 17:40:26.514408 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 17:40:26.514508 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 17:40:26.514863 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 17:40:26.514953 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.515097 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.515245 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 17:40:26.515415 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.515611 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 17:40:26.515736 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.515876 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 17:40:26.516160 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.516865 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.517036 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.517448 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.517555 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.517637 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.517728 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.517819 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.518014 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.518157 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.518277 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.518473 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.518595 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.518799 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.518921 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854428-1-iscsi {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.519124 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.519244 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.519456 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.519557 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.519719 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.519847 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.520039 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.520167 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.520367 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854428-1-iscsi {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.520463 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.520694 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.520789 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.521007 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.521148 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.521317 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.521564 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.522875 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.522875 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.523144 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.523358 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.523477 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.523609 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.523724 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.523724 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.523956 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.524107 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.524233 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.524363 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.524495 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.524625 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.524758 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.524891 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.525016 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.525149 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.525274 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.525404 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.525539 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.525670 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854428-1-iscsi {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.525786 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.525940 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.526077 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.526220 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.526346 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.526546 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.526675 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.526809 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.526935 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854428-1-iscsi {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.527059 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.527182 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.527318 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.527458 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.527595 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.527720 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.527853 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.527987 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.528114 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.528238 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.528362 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.528485 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.528617 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.528743 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.528866 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.528992 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.529166 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.529297 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.529468 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.529605 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.529774 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.529935 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.530105 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.530263 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.530413 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.530589 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.530719 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.530894 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.531029 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.531202 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.531332 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.531511 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.531683 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.531863 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.532034 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.532174 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.532306 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.532434 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.532567 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.532697 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.532821 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.532956 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.533082 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.533238 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.533378 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.533558 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.533704 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.533907 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.534053 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.534183 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.534308 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.534445 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.534582 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.534715 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.534851 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.535018 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.535156 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.535327 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.535457 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.535626 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.535754 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.535927 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.536056 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.536233 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.536360 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.536580 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.536725 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.536863 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.536988 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.537124 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.537257 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.537423 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.537552 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.537744 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.537897 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.538075 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.538211 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.538371 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.538500 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.538690 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.538828 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.539126 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.539277 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.539404 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.539536 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.539662 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.539829 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.540055 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.540193 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.540326 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.540459 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.540584 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.540722 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.540861 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.540987 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.541111 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.541235 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.541388 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.541526 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.541689 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.541818 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.542014 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.542147 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.542285 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.542410 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.542532 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.542692 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.542827 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.543030 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.543166 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.543336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.543462 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.543584 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.543706 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.543877 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.544015 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.544183 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.544310 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.544503 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.544630 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.544810 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.545049 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.545175 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.545297 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.545420 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.545541 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.545672 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.545804 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.545998 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.546114 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.546299 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.546430 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.546600 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.546817 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.546954 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.547079 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.547204 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.547362 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.547619 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.547756 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.547893 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.548024 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.548396 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.548539 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.548678 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.548804 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.548941 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.549067 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.549232 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.549362 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.549533 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.549663 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.549882 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.550032 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.550159 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.550284 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.550457 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.550595 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.550773 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.550902 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.551077 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.551197 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.551384 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.551556 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.551707 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.551837 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.552013 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.552143 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.552319 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.552449 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.552638 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.552765 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.552943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.553079 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.553241 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.553369 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.553541 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.553671 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.553842 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.554007 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.554166 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.554295 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.554470 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.554601 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.554770 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.554907 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.555070 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.555205 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.555367 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.555497 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.555674 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.555810 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.555979 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.556109 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.556281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.556407 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.556581 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.556718 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.556939 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.557068 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.557192 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.557360 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.557497 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.557633 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.557789 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.557993 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.558123 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.558342 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.558481 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.558661 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.558790 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.558994 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.559125 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:40:26.559328 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.559466 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.559648 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.559778 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.559961 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.560089 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.560273 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.560488 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.560626 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.560760 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.560892 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.561016 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.561189 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.561323 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.561499 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.561636 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.561816 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.562005 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.562156 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.562287 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.562484 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.562638 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.562799 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.563422 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.563673 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.563810 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.563993 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.564131 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.564318 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.564445 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.564656 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.564786 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.564981 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.565109 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.565303 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.565445 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.565625 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.565755 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.565970 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.566101 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.566293 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.566433 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.566626 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.566754 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.566965 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.567137 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.567257 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.567402 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.567662 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.567808 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.568058 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.568193 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.568327 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.568471 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.568613 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.568759 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.568911 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.569044 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.569184 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.569432 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.569566 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.569706 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.569839 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.570006 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.570145 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.570274 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.570399 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.570524 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.570654 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.570779 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.570917 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.571043 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.571230 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.571361 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.571545 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.571676 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.571860 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.571982 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.572169 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.572485 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.572821 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.573135 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.573277 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.573405 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.573528 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.573687 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.573815 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.574031 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.574160 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.574318 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.574449 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.574596 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.574726 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.574899 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.575030 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.575216 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.575346 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.575557 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.575690 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.575825 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.575960 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.576158 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.576295 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.576461 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.576591 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.576767 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.576896 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.577117 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.577261 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.577388 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.577514 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.577648 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.577775 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.577979 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.578110 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.578288 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.578432 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.579201 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.579373 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.579545 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.579685 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.579862 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.580001 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.580176 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.580306 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.580491 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.580621 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.580800 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.580939 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.581113 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.581242 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.581426 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.581548 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.581733 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.581921 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.582092 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.582223 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.582407 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.582557 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.582721 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.582849 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.583024 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.583152 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.583334 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.583462 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.583638 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.583766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.583956 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.584093 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.584271 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.584394 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.584574 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.584709 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.584885 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.584999 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.585260 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.585388 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.585532 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.585657 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.585811 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.585960 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.586200 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.586348 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.586476 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.586601 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.586733 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.586868 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.587049 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.587202 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.587412 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.587542 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.587675 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.587917 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.588051 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.588190 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.588318 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.588444 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.588700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.588845 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.588981 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.589128 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.589262 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.589390 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.589499 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.589624 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.589757 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.589921 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.590048 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.590182 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.590318 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.590444 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.590579 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.590713 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.590847 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.590974 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.591150 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.591282 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.591486 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.591617 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.591886 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.592035 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.592162 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.592289 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.592430 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.592557 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.592724 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.592852 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.593032 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.593168 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.593346 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.593476 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.593702 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.593838 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.594068 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.594217 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.594462 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.594601 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.594758 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.595084 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.595386 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.595527 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.595710 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.595846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.596022 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.596152 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.596389 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.596539 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.596667 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.596791 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.596941 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.597071 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.597266 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.597410 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.597608 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.597739 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.597902 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.598031 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.598231 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.598369 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.598538 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.598674 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.598853 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.598984 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.599187 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.599324 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.599451 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.599577 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.599753 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.599896 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.600064 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.600208 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.600380 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.600518 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.600690 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.600819 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.601005 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.601136 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.601315 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.601444 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.601638 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.601770 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.602001 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.602194 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.602312 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.602435 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.602572 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.602709 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.602877 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.603007 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.603189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.603316 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.603512 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.603650 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.603818 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.603958 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.604129 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.604266 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.604440 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.604577 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.604746 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.604876 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.605054 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.605184 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.605414 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.605553 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.605679 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.605804 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.605982 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.606108 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.606277 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.606408 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.606589 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.606719 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.606896 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.607026 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.607205 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.607342 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.607508 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.607723 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.607860 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.607995 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.608131 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.608256 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.608440 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.608569 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.608747 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.608885 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.609056 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.609196 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.609369 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.609499 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.609673 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.609838 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.610049 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.610178 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.610430 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.610566 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.610692 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.610826 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.610953 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.611080 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.611260 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.611398 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.611568 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.611707 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.611875 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.612005 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.612188 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.612317 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.612515 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.612644 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.612828 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.612955 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.613152 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.613279 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.613457 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.613586 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.613766 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.614045 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.614175 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.614301 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.614444 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.614569 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.614714 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.614842 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.615009 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.615164 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.615303 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.615647 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.615846 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.616051 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.616259 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.616259 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.616561 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.616679 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.616803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.616927 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.617050 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.617187 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.617313 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.617438 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.617614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.617757 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.617991 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.618137 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.618264 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.618387 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.618555 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.618684 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.618867 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.619005 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.619193 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.619329 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.619510 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.619637 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.619822 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.620089 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.620218 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.620420 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.620558 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.620730 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.620865 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.621042 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.621169 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.621358 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.621487 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.621665 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.621813 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.622012 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.622149 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.622325 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.622454 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.622632 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.622770 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.622943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.623092 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.623253 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.623380 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.623557 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.623824 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.623965 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.624156 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.624282 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.624457 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.624585 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.624761 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.624900 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.625064 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.625193 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.625369 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.626070 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.626267 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.626396 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.626547 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.626671 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.626888 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.627026 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.627198 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.627327 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.627515 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.627643 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.627817 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.627958 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.628149 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.628285 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.628412 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.628543 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.628710 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.628856 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.629013 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.629150 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.629315 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.629456 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.629618 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.629746 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.629942 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.630086 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.630249 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.630375 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.630555 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.630684 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.630861 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.631000 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.631177 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.631305 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.631484 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.631612 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.631794 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.631931 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.632098 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.632219 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.632417 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.632553 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.632720 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.632849 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.633022 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.633150 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.633321 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.633448 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.633622 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.633749 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.633930 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.634067 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.634235 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.634377 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.634542 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.634671 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.634847 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.634982 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.635152 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.635291 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.635457 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.635594 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.635755 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.635891 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.636059 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.636197 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.636360 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.636495 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.636672 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.636800 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.636978 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.637107 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.637281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.637417 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.637587 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.637714 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.637912 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.638043 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.638246 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.638395 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.638522 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.638653 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.638812 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.638941 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.639112 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.639241 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.639413 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.639547 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.639713 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.639841 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.640015 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.640142 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.640316 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.640487 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.640629 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.640754 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.640915 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.641062 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.641802 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.642016 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.642198 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.642320 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.642511 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.642640 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.642820 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.642957 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.643126 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.643255 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.643434 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.643570 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.643739 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.643882 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.644042 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.644170 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.644349 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.644486 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.644670 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.644809 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.644988 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.645115 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.645288 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.645416 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.645590 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.645719 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.645913 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.646043 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.646219 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.646360 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.646521 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.646643 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.646826 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.646955 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.647126 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.647250 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.647429 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.647564 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.647726 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.647854 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.648027 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.648155 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.648368 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.648538 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.648667 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.648859 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.648987 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.649166 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.649295 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.649477 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.649605 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.649781 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.649949 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.650115 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.650245 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.650433 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.650560 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.650790 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.650927 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.651094 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.651406 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.651723 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.652031 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.652166 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.652341 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.652470 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.652653 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.652786 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.652952 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.653079 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.653263 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.653466 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.653593 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.653723 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.653879 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.654006 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.654175 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.654312 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.654478 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.654801 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.655108 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.655297 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.655455 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.655621 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.655808 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.655978 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.656132 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.656294 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.656457 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.656688 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.656876 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.657006 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.657131 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.657310 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.657468 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.657630 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.657760 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.658040 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.658350 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.658659 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.658790 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.658967 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.659097 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.659277 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.659415 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.659586 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.659716 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.659893 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.660030 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.660195 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.660344 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.660503 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.660632 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.660808 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.660944 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.661109 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.661431 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.661738 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.662026 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.662156 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.662357 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.662486 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.662659 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.662796 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.662965 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.663093 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.663266 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.663394 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.663615 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.663749 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.663947 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.664074 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.664258 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.664386 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.664568 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.664702 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.664875 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.665003 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.665183 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.665310 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.665492 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.665623 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.665801 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.665950 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.666126 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.666266 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.666442 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.666568 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.666757 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.666885 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.667073 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.667320 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.667442 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.667556 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.667682 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.667807 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.667976 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.668120 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.668288 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.668416 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.668610 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.668786 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.668941 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.669101 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.669249 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.669407 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.669552 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.669691 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.669882 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.670021 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.670151 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.670279 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.670403 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.670528 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.670767 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.670987 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.671120 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.671250 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.671384 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.671517 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.671763 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.671895 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.672071 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.672210 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.672463 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.672662 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.672815 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.672960 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.673087 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.673472 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.673606 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.673740 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.673887 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.674078 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.674208 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.674465 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.674592 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.674790 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.674928 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.675108 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.675239 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.675413 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.675541 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.675720 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.675848 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.676020 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.676148 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.676331 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.676458 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.676648 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.676777 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.676954 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.677081 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.677261 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.677405 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.677641 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.677780 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.677951 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.678089 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.678218 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.678343 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.678539 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.678693 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.678925 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.679055 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.679232 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.679361 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.679537 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.679676 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.679846 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.679975 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.680148 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.680285 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.680452 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.680595 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.680772 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.680902 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.681075 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.681217 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.681383 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.681521 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.681784 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.681990 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.682119 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.682244 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.682430 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.682560 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.682761 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.682883 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.683091 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.683221 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.683404 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.683540 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.683718 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.683852 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.684026 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.684163 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.684349 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.684478 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.684670 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.684807 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.684976 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.685114 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.685298 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.685436 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.685607 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.685737 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.685931 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.686074 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.686237 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.686366 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.686542 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.686672 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.686883 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.687022 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.687185 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.687314 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.687509 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.687641 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.687842 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.688520 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.688683 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.688813 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.689075 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.689206 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.689417 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.689557 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.689728 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.689876 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.690070 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.690200 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.690384 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.690522 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.690696 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.690826 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.690998 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.691124 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.691303 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.691440 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.691614 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.691743 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.691915 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.692046 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.692219 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.692349 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.692521 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.692649 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.692826 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.692949 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.693127 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.693257 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.693426 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.693562 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.693727 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.693918 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.694071 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.694194 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.694376 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.694504 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.694692 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.694866 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.694995 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.695128 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.695305 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.695436 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.695612 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.695755 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.695936 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.696071 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.696270 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.696398 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.696569 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.696710 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.696901 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.697030 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.697208 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.697336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.697531 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.697668 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.697908 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.698046 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.698173 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.698298 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.698481 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.698611 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.698794 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.698923 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.699124 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.699252 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.699387 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.699520 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.699688 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.699816 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.699995 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.700121 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.700299 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.700427 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.700609 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.700735 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.700910 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.701046 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.701222 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.701471 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.701599 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.701797 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.701949 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.702157 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.702293 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.702420 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.702544 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.702726 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.702856 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.703036 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.703159 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.703340 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.703467 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.704265 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.704410 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.704532 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.704642 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.704826 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.704939 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.705167 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.705309 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.705446 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.705580 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.705757 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.705919 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.706097 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.706237 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.706416 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.706547 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.706738 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.706875 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.707048 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.707184 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.707347 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.707475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.707713 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.707849 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.707999 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.708180 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.708313 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.708448 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.708576 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.708701 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.708859 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.708988 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.709202 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.709389 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.709568 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.709719 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.710018 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.710171 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.710327 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.710475 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.710633 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.710793 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.710949 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.711095 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.711237 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.711391 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.711552 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.711711 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.711854 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.711997 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.712140 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.712283 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.712424 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.712588 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.712732 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.712877 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.713019 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.713189 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.713343 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.713486 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.713638 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.713780 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.713962 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.714150 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.714306 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.714461 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.714617 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.714758 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.714899 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.715054 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.715210 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.715363 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.715545 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.715689 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.715835 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.715998 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.716153 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.716295 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.716449 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.716602 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.716756 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.716915 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.717057 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.717210 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.717350 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.717491 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.717647 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.717801 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.717968 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.718150 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.718288 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.718441 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.718600 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.718741 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.718879 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.719033 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.719218 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.719358 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.719727 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.719884 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.720027 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.720179 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.720323 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.720467 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.720622 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.720764 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.720941 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.721115 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.721264 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.721420 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.721587 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.721728 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.722006 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.722165 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.722334 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.722490 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.722631 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.722771 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.722935 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.723081 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.723252 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.723429 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.723571 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.723721 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.723868 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.724017 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.724164 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.724313 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.724456 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.724595 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.724734 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.724873 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.725021 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.725161 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.725308 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.725449 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.725642 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.725794 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.725981 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.726124 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.726263 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.726410 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.726552 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.726690 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.726840 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.726988 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.727128 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.727267 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.727406 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.727690 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.727845 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.727994 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.728141 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.728306 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.728460 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.728611 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.728758 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.728898 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.729037 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.729183 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.729426 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.729606 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.729748 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.729921 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.730068 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.730209 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.730348 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.730504 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.730654 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.730802 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.730951 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.731098 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.731238 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.731387 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.731538 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.731678 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.731825 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.731965 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.732118 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.732266 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.732406 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.732546 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.732685 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.732834 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.732988 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.733129 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.733267 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.733416 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.733556 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.733694 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.733843 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.734166 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.734312 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.734476 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.734623 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.734828 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.734990 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.735157 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.735469 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.735688 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.735851 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.736041 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.736202 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.736347 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.736487 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.736627 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.736766 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.736916 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.737057 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.737243 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.737390 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.737553 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.737708 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.737881 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.738030 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.738172 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.738312 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.738463 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.738682 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.738825 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.738964 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.739104 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.739243 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.739382 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.739620 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.739778 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.739919 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.740059 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.740199 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.740338 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.740487 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.740628 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.740768 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.740907 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.741054 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.741203 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.741352 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.741503 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.741651 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.741791 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.742055 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.742215 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.742358 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.742497 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.742676 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.742823 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.742993 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.743153 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.743296 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.743435 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.743585 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.743724 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.743895 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.744055 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.744197 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.744337 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.744478 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.744617 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.744790 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.744946 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.745120 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.745276 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.745426 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.745566 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.745713 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.745917 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.746109 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.746254 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.746427 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.746574 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.746732 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.746874 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.747022 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.747162 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.747335 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.747501 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.747642 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.747780 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.747919 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.748058 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.748233 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.748395 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.748550 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.748690 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.748829 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.748967 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.749141 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.749308 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.749485 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.749648 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.749922 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.750072 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.750212 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.750364 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.751091 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.751242 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.751383 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.751523 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.751674 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.751815 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.751969 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.752109 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.752248 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.752387 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.752535 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.752678 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.752817 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.752956 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.753103 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.753245 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.753393 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.753533 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.753684 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.753823 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.753991 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.754143 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.754283 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.754422 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.754561 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.754700 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.754841 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.754993 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.755134 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.755274 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.755413 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.755571 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.755711 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.755903 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.756048 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.756188 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.756328 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.756474 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.756623 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.756788 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.756941 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.757122 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.757276 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.757464 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.757622 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.757797 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.757992 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.758156 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.758303 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.758466 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.758625 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.758766 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.758906 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.759046 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.759186 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.759359 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.759525 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.759666 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.759806 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.760032 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.760178 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.760332 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.760473 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.760613 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.760752 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.760898 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.761040 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.761189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.761329 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.761478 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.761617 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.761756 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.761930 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.762089 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.762239 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.762379 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.762518 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.762658 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.762797 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.762946 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.763140 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.763312 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.763454 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.763594 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.763742 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.763882 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.764022 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.764162 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.764301 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.764440 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.764588 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.764729 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.764868 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.765017 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.765167 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.765308 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.765455 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.765801 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.766073 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.766819 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.766977 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.767148 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.767326 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.767594 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.767753 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.767903 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.768057 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.768273 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.768418 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.768558 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.768705 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.768846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.768984 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.769136 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.769276 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.769423 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.769564 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.769703 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.769842 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.770047 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.770261 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.770407 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.770548 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.770688 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.770836 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.770978 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.771125 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.771267 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.771407 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.771547 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.771696 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.771848 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.771988 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.772128 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.772267 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.772407 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.772562 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.772704 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.772845 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.772984 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.773131 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.773282 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.773470 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.773616 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.773767 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.773923 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.774080 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.774234 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.774374 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.774514 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 17:40:26.774660 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.774807 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.775030 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.775342 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.775656 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.775997 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.776281 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.776593 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.776910 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.777224 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.777537 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.777978 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.778191 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.778520 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.778850 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.779161 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.779492 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.779820 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.780168 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.780487 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.780834 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.781163 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.781481 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.781923 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.782407 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:40:26.782759 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 17:40:26.930194 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO dbcounter [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] Registered counter for database nova_api Aug 24 17:40:26.939193 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO dbcounter [None req-8457853a-76f2-4d42-905f-155f14d1f612 None None] Registered counter for database nova_api Aug 24 17:40:26.951798 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_db.sqlalchemy.engines [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:40:26.958902 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG dbcounter [-] [112626] Writer thread running {{(pid=112626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:40:26.959883 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG oslo_db.sqlalchemy.engines [None req-8457853a-76f2-4d42-905f-155f14d1f612 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:40:26.966650 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG dbcounter [-] [112625] Writer thread running {{(pid=112625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:40:27.015396 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.context [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6269e10f-dbf4-40a1-8167-ac8cb84bb97a(cell1) {{(pid=112626) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 17:40:27.019514 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:27.019995 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:27.021616 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:27.022380 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:27.022828 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:27.023836 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.context [None req-8457853a-76f2-4d42-905f-155f14d1f612 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6269e10f-dbf4-40a1-8167-ac8cb84bb97a(cell1) {{(pid=112625) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 17:40:27.024912 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:27.026921 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO dbcounter [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] Registered counter for database nova_cell0 Aug 24 17:40:27.027737 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG oslo_concurrency.lockutils [None req-8457853a-76f2-4d42-905f-155f14d1f612 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:27.028214 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG oslo_concurrency.lockutils [None req-8457853a-76f2-4d42-905f-155f14d1f612 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:27.029800 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG oslo_concurrency.lockutils [None req-8457853a-76f2-4d42-905f-155f14d1f612 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:27.030578 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG oslo_concurrency.lockutils [None req-8457853a-76f2-4d42-905f-155f14d1f612 None None] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:27.031034 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG oslo_concurrency.lockutils [None req-8457853a-76f2-4d42-905f-155f14d1f612 None None] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:27.032303 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO dbcounter [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] Registered counter for database nova_cell1 Aug 24 17:40:27.033136 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG oslo_concurrency.lockutils [None req-8457853a-76f2-4d42-905f-155f14d1f612 None None] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:27.035165 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO dbcounter [None req-8457853a-76f2-4d42-905f-155f14d1f612 None None] Registered counter for database nova_cell0 Aug 24 17:40:27.040007 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_db.sqlalchemy.engines [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:40:27.040952 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO dbcounter [None req-8457853a-76f2-4d42-905f-155f14d1f612 None None] Registered counter for database nova_cell1 Aug 24 17:40:27.041310 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_db.sqlalchemy.engines [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:40:27.047855 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG dbcounter [-] [112626] Writer thread running {{(pid=112626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:40:27.050837 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG oslo_db.sqlalchemy.engines [None req-8457853a-76f2-4d42-905f-155f14d1f612 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:40:27.051188 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG dbcounter [-] [112626] Writer thread running {{(pid=112626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:40:27.052763 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG oslo_db.sqlalchemy.engines [None req-8457853a-76f2-4d42-905f-155f14d1f612 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:40:27.065410 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG dbcounter [-] [112625] Writer thread running {{(pid=112625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:40:27.067936 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG dbcounter [-] [112625] Writer thread running {{(pid=112625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:40:27.195296 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO dbcounter [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] Registered counter for database nova_cell0 Aug 24 17:40:27.202506 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_db.sqlalchemy.engines [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:40:27.207415 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG dbcounter [-] [112626] Writer thread running {{(pid=112626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:40:27.359715 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO dbcounter [None req-8457853a-76f2-4d42-905f-155f14d1f612 None None] Registered counter for database nova_cell0 Aug 24 17:40:27.371456 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG oslo_db.sqlalchemy.engines [None req-8457853a-76f2-4d42-905f-155f14d1f612 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:40:27.376440 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG dbcounter [-] [112625] Writer thread running {{(pid=112625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:40:27.621721 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: WARNING keystonemiddleware.auth_token [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:40:27.629904 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: WARNING keystonemiddleware.auth_token [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:40:27.697312 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: WARNING keystonemiddleware.auth_token [None req-8457853a-76f2-4d42-905f-155f14d1f612 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:40:27.705032 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: WARNING keystonemiddleware.auth_token [None req-8457853a-76f2-4d42-905f-155f14d1f612 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:40:27.977033 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: WARNING keystonemiddleware.auth_token [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:40:27.983307 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: WARNING keystonemiddleware.auth_token [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:40:27.989659 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557f1cb7c9c0 pid: 112626 (default app) Aug 24 17:40:27.992229 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:27.993499 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] 10.222.0.76 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002052 Aug 24 17:40:27.993972 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 788 bytes} [Wed Aug 24 17:40:27 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:28.050165 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: WARNING keystonemiddleware.auth_token [None req-8457853a-76f2-4d42-905f-155f14d1f612 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:40:28.056211 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: WARNING keystonemiddleware.auth_token [None req-8457853a-76f2-4d42-905f-155f14d1f612 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:40:28.061518 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557f1cb7c9c0 pid: 112625 (default app) Aug 24 17:41:50.858740 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:50.859743 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 24 17:41:50.860143 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 2/2] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 17:41:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:50.872707 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG dbcounter [-] [112625] Writing DB stats nova_api:SELECT=3 {{(pid=112625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:50.874168 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG dbcounter [-] [112625] Writing DB stats nova_cell0:SELECT=3 {{(pid=112625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:50.874885 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG dbcounter [-] [112625] Writing DB stats nova_cell1:SELECT=3 {{(pid=112625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:50.875772 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG dbcounter [-] [112625] Writing DB stats nova_cell0:SELECT=3 {{(pid=112625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:51.775075 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-3d183b94-9b4e-44f3-9be1-bdb928f96059 admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:51.807986 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-3d183b94-9b4e-44f3-9be1-bdb928f96059 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.940871 Aug 24 17:41:51.808748 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 1/3] 10.222.0.76 () {60 vars in 1292 bytes} [Wed Aug 24 17:41:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:54.221931 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:54.222953 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-7f021623-22c5-4f03-8d51-a80d8e5ca8b5 None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 24 17:41:54.228624 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 3/4] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 17:41:54 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:54.657205 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-feb9a6ce-a7f6-4bf8-81f2-6265901578c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "ram": 256, "name": "cirros256", "id": "c1", "disk": 1, "os-flavor-access:is_public": true}} {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:54.678048 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:41:54.678048 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: warnings.warn(msg) Aug 24 17:41:54.764038 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-feb9a6ce-a7f6-4bf8-81f2-6265901578c0 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.533743 Aug 24 17:41:54.766082 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 2/5] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 17:41:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:41:54.779957 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG dbcounter [-] [112626] Writing DB stats nova_api:SELECT=3 {{(pid=112626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:54.781611 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG dbcounter [-] [112626] Writing DB stats nova_cell1:SELECT=3 {{(pid=112626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:54.782971 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG dbcounter [-] [112626] Writing DB stats nova_cell0:SELECT=3 {{(pid=112626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:54.783826 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG dbcounter [-] [112626] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:55.006584 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-bbece028-300c-441f-815f-ae19034d74bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:55.010923 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:41:55.010923 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: warnings.warn(msg) Aug 24 17:41:55.117586 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-bbece028-300c-441f-815f-ae19034d74bc admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.344037 Aug 24 17:41:55.118134 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 4/6] 10.222.0.76 () {64 vars in 1336 bytes} [Wed Aug 24 17:41:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:41:57.493979 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-feb9a6ce-a7f6-4bf8-81f2-6265901578c0 admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:57.495022 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-feb9a6ce-a7f6-4bf8-81f2-6265901578c0 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 24 17:41:57.495449 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 3/7] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 17:41:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:41:58.187760 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-4fb7ff3a-333b-49e2-a070-ee635f5470db admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "disk": 5, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "ram": 512, "swap": 0}} {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:58.207298 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:41:58.207298 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: warnings.warn(msg) Aug 24 17:41:58.296952 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-4fb7ff3a-333b-49e2-a070-ee635f5470db admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.794881 Aug 24 17:41:58.297755 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 5/8] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 17:41:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:41:58.310598 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-8a9b25e9-da35-4131-b475-83eef5483525 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:58.313345 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:41:58.313345 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: warnings.warn(msg) Aug 24 17:41:58.428741 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-8a9b25e9-da35-4131-b475-83eef5483525 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122747 Aug 24 17:41:58.429400 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 4/9] 10.222.0.76 () {64 vars in 1336 bytes} [Wed Aug 24 17:41:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:00.869758 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-4fb7ff3a-333b-49e2-a070-ee635f5470db admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:00.870809 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-4fb7ff3a-333b-49e2-a070-ee635f5470db admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 24 17:42:00.871836 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 6/10] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 17:42:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:01.305102 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-e22b57f0-4f69-48af-9ab9-6ae4705a6019 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G", "vcpus": 1, "swap": 0, "id": "d2"}} {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:01.392676 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-e22b57f0-4f69-48af-9ab9-6ae4705a6019 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.514463 Aug 24 17:42:01.393271 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 5/11] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 17:42:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:42:01.406100 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-6cd15fca-6081-4056-9c2a-87df2eaa9b16 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:01.476313 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-6cd15fca-6081-4056-9c2a-87df2eaa9b16 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074562 Aug 24 17:42:01.476904 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 7/12] 10.222.0.76 () {64 vars in 1336 bytes} [Wed Aug 24 17:42:01 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:03.865585 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-e22b57f0-4f69-48af-9ab9-6ae4705a6019 admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:03.866710 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-e22b57f0-4f69-48af-9ab9-6ae4705a6019 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 24 17:42:03.867216 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 6/13] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 17:42:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:04.326641 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-123044d5-040e-4ddf-9820-e45efa67090f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "disk": 10}} {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:04.408698 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-123044d5-040e-4ddf-9820-e45efa67090f admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.535032 Aug 24 17:42:04.409308 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 8/14] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 17:42:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:42:04.422511 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-cca2a701-5f28-4d4d-bb60-0d129ee25cc8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:04.511095 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-cca2a701-5f28-4d4d-bb60-0d129ee25cc8 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093207 Aug 24 17:42:04.511950 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 7/15] 10.222.0.76 () {64 vars in 1336 bytes} [Wed Aug 24 17:42:04 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:06.895658 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-123044d5-040e-4ddf-9820-e45efa67090f admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:06.896659 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-123044d5-040e-4ddf-9820-e45efa67090f admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 24 17:42:06.897056 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 9/16] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 17:42:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:07.328919 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-65df1482-c5c4-421c-afee-4e83a5310905 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds4G", "disk": 20, "id": "d4", "swap": 0, "ram": 4096}} {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:07.415958 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-65df1482-c5c4-421c-afee-4e83a5310905 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.511179 Aug 24 17:42:07.416518 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 8/17] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 17:42:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:42:07.429772 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-41bfa1eb-192e-46e0-aabc-c1aaf755f8d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:07.560550 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-41bfa1eb-192e-46e0-aabc-c1aaf755f8d1 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.134540 Aug 24 17:42:07.561161 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 10/18] 10.222.0.76 () {64 vars in 1336 bytes} [Wed Aug 24 17:42:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:10.004877 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-65df1482-c5c4-421c-afee-4e83a5310905 admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:10.005933 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-65df1482-c5c4-421c-afee-4e83a5310905 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 24 17:42:10.006374 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 9/19] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 17:42:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:10.436539 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-3374cb4d-0d49-4fb2-9722-869e4230dc82 admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:10.467641 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-3374cb4d-0d49-4fb2-9722-869e4230dc82 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.454356 Aug 24 17:42:10.468526 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 11/20] 10.222.0.76 () {60 vars in 1292 bytes} [Wed Aug 24 17:42:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:42:12.941146 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-65df1482-c5c4-421c-afee-4e83a5310905 admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:12.942486 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-65df1482-c5c4-421c-afee-4e83a5310905 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001929 Aug 24 17:42:12.943030 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 10/21] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 17:42:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:13.444990 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-3a86cfec-fe42-412c-becd-8b07914094d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.tiny", "ram": 512, "id": "1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0}} {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:13.530922 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-3a86cfec-fe42-412c-becd-8b07914094d6 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.580051 Aug 24 17:42:13.531715 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 12/22] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 17:42:12 2022] POST /compute/v2.1/flavors => generated 402 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:42:13.544700 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-4840cc8b-91b8-4687-a7dd-9b086a89823a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:13.631271 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-4840cc8b-91b8-4687-a7dd-9b086a89823a admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090221 Aug 24 17:42:13.631996 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 11/23] 10.222.0.76 () {64 vars in 1333 bytes} [Wed Aug 24 17:42:13 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:15.977072 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-3a86cfec-fe42-412c-becd-8b07914094d6 admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:15.978266 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-3a86cfec-fe42-412c-becd-8b07914094d6 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001636 Aug 24 17:42:15.978744 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 13/24] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 17:42:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:16.366102 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-37e31737-bd6f-48b5-84b8-99edd777bdf8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:16.434964 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-37e31737-bd6f-48b5-84b8-99edd777bdf8 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.448955 Aug 24 17:42:16.435528 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 12/25] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 17:42:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:42:16.447557 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-8a641899-43a1-48c0-bf19-f2796a07a392 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:16.538821 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-8a641899-43a1-48c0-bf19-f2796a07a392 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094826 Aug 24 17:42:16.539372 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 14/26] 10.222.0.76 () {64 vars in 1333 bytes} [Wed Aug 24 17:42:16 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:18.931538 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-37e31737-bd6f-48b5-84b8-99edd777bdf8 admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:18.932557 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-37e31737-bd6f-48b5-84b8-99edd777bdf8 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 24 17:42:18.932964 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 13/27] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 17:42:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:19.387618 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-5f645620-dc92-40c9-997f-3ed0b7313d6b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.medium", "swap": 0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "ram": 4096, "id": "3"}} {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:19.996033 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-5f645620-dc92-40c9-997f-3ed0b7313d6b admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.056444 Aug 24 17:42:19.996798 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 15/28] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 17:42:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:42:20.009127 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-1fdb006a-d74a-492d-b62e-b6c5c89a9732 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:20.109301 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-1fdb006a-d74a-492d-b62e-b6c5c89a9732 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103785 Aug 24 17:42:20.110385 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 14/29] 10.222.0.76 () {64 vars in 1333 bytes} [Wed Aug 24 17:42:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:22.493007 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-5f645620-dc92-40c9-997f-3ed0b7313d6b admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:22.494082 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-5f645620-dc92-40c9-997f-3ed0b7313d6b admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 24 17:42:22.494938 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 16/30] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 17:42:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:22.960129 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-4fa0032b-13a2-489f-8e8e-f3a1e13cd0ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "rxtx_factor": 1.0, "id": "4", "name": "m1.large"}} {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:22.969018 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG dbcounter [-] [112625] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:23.078760 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-4fa0032b-13a2-489f-8e8e-f3a1e13cd0ae admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.575477 Aug 24 17:42:23.079967 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 15/31] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 17:42:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:42:23.092469 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-d560244a-75e1-42ff-9ec4-19d4186bd888 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:23.222185 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-d560244a-75e1-42ff-9ec4-19d4186bd888 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.133746 Aug 24 17:42:23.222793 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 17/32] 10.222.0.76 () {64 vars in 1333 bytes} [Wed Aug 24 17:42:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:25.646075 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-4fa0032b-13a2-489f-8e8e-f3a1e13cd0ae admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:25.647864 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-4fa0032b-13a2-489f-8e8e-f3a1e13cd0ae admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002260 Aug 24 17:42:25.648352 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 16/33] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 17:42:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:26.113611 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-17886c38-afec-443a-988c-6c5a5de0d104 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 160, "name": "m1.xlarge", "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:26.195615 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-17886c38-afec-443a-988c-6c5a5de0d104 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.539958 Aug 24 17:42:26.202483 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 18/34] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 17:42:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:42:26.208680 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-36fa1ac7-43c0-437a-8134-6b83cbfdb60a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:26.440224 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-36fa1ac7-43c0-437a-8134-6b83cbfdb60a admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.235113 Aug 24 17:42:26.441340 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 17/35] 10.222.0.76 () {64 vars in 1333 bytes} [Wed Aug 24 17:42:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:45.657974 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-17886c38-afec-443a-988c-6c5a5de0d104 admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:45.658987 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-17886c38-afec-443a-988c-6c5a5de0d104 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 24 17:42:45.659385 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 19/36] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 17:42:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:45.670554 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG dbcounter [-] [112625] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:46.082622 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-04ee6420-f65f-49e5-8c19-2b8899751c0d admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:46.102459 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-04ee6420-f65f-49e5-8c19-2b8899751c0d admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.436687 Aug 24 17:42:46.103020 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 18/37] 10.222.0.76 () {60 vars in 1292 bytes} [Wed Aug 24 17:42:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:42:47.206335 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-17886c38-afec-443a-988c-6c5a5de0d104 admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:47.207358 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-17886c38-afec-443a-988c-6c5a5de0d104 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 24 17:42:47.207766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 20/38] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 17:42:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:47.743268 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-59bc02af-3aec-413c-911d-9d8125b5d9ed admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:47.749338 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.wsgi [None req-59bc02af-3aec-413c-911d-9d8125b5d9ed admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-59bc02af-3aec-413c-911d-9d8125b5d9ed admin admin] Request method failure captured: Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Accept: application/json Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Accept-Encoding: gzip, deflate Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Connection: keep-alive Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Content-Length: 0 Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Host: 10.222.0.76 Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Openstack-Api-Version: compute 2.90 Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Openstack-System-Scope: None Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: User-Agent: python-novaclient Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Auth-Token: gAAAAABjBmMXgtHIOE79TNTh8jWdPOzb5VEcCZlQfFb185rXHB0-GAWsbZtHhSkw5JsIW4Afb5oRSxnomSbG5hBRHovr7gQQaQPP4cHWoFg_hQzdentIqkhtW1mmVRNNoHihmzD8ymmxN0BLDl5aDLOgOn7qVYQBHNH0TGBT3z6fVbKDs15v77g Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Domain-Id: None Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Domain-Name: None Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Identity-Status: Confirmed Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Is-Admin-Project: True Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Project-Domain-Id: default Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Project-Domain-Name: Default Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Project-Id: 74aebe409e204672bb76c767e1d15f99 Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Project-Name: admin Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Role: reader,member,admin Aug 24 17:42:47.752614 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Roles: reader,member,admin Aug 24 17:42:47.754314 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/74aebe409e204672bb76c767e1d15f99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74aebe409e204672bb76c767e1d15f99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_74aebe409e204672bb76c767e1d15f99", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74aebe409e204672bb76c767e1d15f99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:42:47.754314 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Tenant: admin Aug 24 17:42:47.754314 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Tenant-Id: 74aebe409e204672bb76c767e1d15f99 Aug 24 17:42:47.754314 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Tenant-Name: admin Aug 24 17:42:47.754314 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-User: admin Aug 24 17:42:47.754314 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-User-Domain-Id: default Aug 24 17:42:47.754314 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-User-Domain-Name: Default Aug 24 17:42:47.754314 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-User-Id: 9c52ecdd884449e5b0fb195998b79885 Aug 24 17:42:47.754314 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-User-Name: admin Aug 24 17:42:47.754314 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: method: > Aug 24 17:42:47.754314 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: exception: Flavor 42 could not be found. Aug 24 17:42:47.754314 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: action_args: {'id': '42'} Aug 24 17:42:47.754314 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:42:47.754314 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:47.755475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:42:47.755475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:42:47.755475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:42:47.755475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:42:47.755475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:42:47.755475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:42:47.755475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:42:47.755475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:42:47.755475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:42:47.755475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:47.755475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:42:47.755475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:42:47.755475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 17:42:47.755475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Aug 24 17:42:47.755475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:47.755475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Aug 24 17:42:47.755475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:47.755475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:47.755475 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:47.756925 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:42:47.756925 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:42:47.756925 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:42:47.756925 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:47.756925 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:42:47.756925 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:42:47.756925 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 17:42:47.756925 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Aug 24 17:42:47.756925 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:47.756925 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Aug 24 17:42:47.756925 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:47.756925 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:47.756925 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:47.756925 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:42:47.756925 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:42:47.756925 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 17:42:47.756925 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Aug 24 17:42:47.756925 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-59bc02af-3aec-413c-911d-9d8125b5d9ed admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:42:47.758263 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-59bc02af-3aec-413c-911d-9d8125b5d9ed admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.409187 Aug 24 17:42:47.758263 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 19/39] 10.222.0.76 () {60 vars in 1190 bytes} [Wed Aug 24 17:42:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 17:42:47.763927 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-e693598d-cb02-45f3-b706-41778f56e7b9 admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:47.767855 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG dbcounter [-] [112626] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:47.787197 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-e693598d-cb02-45f3-b706-41778f56e7b9 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026568 Aug 24 17:42:47.787528 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 21/40] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Aug 24 17:42:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:42:47.798666 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-583a0d1f-30e1-4060-a6d4-f2e0ba86bee2 admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:47.823478 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-583a0d1f-30e1-4060-a6d4-f2e0ba86bee2 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028336 Aug 24 17:42:47.824400 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 20/41] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Aug 24 17:42:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:42:47.834191 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-0750e162-fc94-4d46-bb43-dad2d3e282be admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:47.841002 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.wsgi [None req-0750e162-fc94-4d46-bb43-dad2d3e282be admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-0750e162-fc94-4d46-bb43-dad2d3e282be admin admin] Request method failure captured: Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Accept: application/json Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Accept-Encoding: gzip, deflate Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Connection: keep-alive Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Content-Length: 0 Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Host: 10.222.0.76 Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Openstack-Api-Version: compute 2.90 Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Openstack-System-Scope: None Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: User-Agent: python-novaclient Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Auth-Token: gAAAAABjBmMXgtHIOE79TNTh8jWdPOzb5VEcCZlQfFb185rXHB0-GAWsbZtHhSkw5JsIW4Afb5oRSxnomSbG5hBRHovr7gQQaQPP4cHWoFg_hQzdentIqkhtW1mmVRNNoHihmzD8ymmxN0BLDl5aDLOgOn7qVYQBHNH0TGBT3z6fVbKDs15v77g Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Domain-Id: None Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Domain-Name: None Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Identity-Status: Confirmed Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Is-Admin-Project: True Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Project-Domain-Id: default Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Project-Domain-Name: Default Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Project-Id: 74aebe409e204672bb76c767e1d15f99 Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Project-Name: admin Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Role: reader,member,admin Aug 24 17:42:47.844280 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Roles: reader,member,admin Aug 24 17:42:47.845801 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/74aebe409e204672bb76c767e1d15f99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74aebe409e204672bb76c767e1d15f99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_74aebe409e204672bb76c767e1d15f99", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74aebe409e204672bb76c767e1d15f99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:42:47.845801 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Tenant: admin Aug 24 17:42:47.845801 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Tenant-Id: 74aebe409e204672bb76c767e1d15f99 Aug 24 17:42:47.845801 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Tenant-Name: admin Aug 24 17:42:47.845801 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-User: admin Aug 24 17:42:47.845801 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-User-Domain-Id: default Aug 24 17:42:47.845801 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-User-Domain-Name: Default Aug 24 17:42:47.845801 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-User-Id: 9c52ecdd884449e5b0fb195998b79885 Aug 24 17:42:47.845801 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-User-Name: admin Aug 24 17:42:47.845801 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: method: > Aug 24 17:42:47.845801 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: exception: Flavor 42 could not be found. Aug 24 17:42:47.845801 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: action_args: {'id': '42'} Aug 24 17:42:47.845801 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:42:47.845801 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:47.846766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:42:47.846766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:42:47.846766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:42:47.846766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:42:47.846766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:42:47.846766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:42:47.846766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:42:47.846766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:42:47.846766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:42:47.846766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:47.846766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:42:47.846766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:42:47.846766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 17:42:47.846766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Aug 24 17:42:47.846766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:47.846766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Aug 24 17:42:47.846766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:47.846766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:47.846766 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:47.847881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:42:47.847881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:42:47.847881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:42:47.847881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:47.847881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:42:47.847881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:42:47.847881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 17:42:47.847881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Aug 24 17:42:47.847881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:47.847881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Aug 24 17:42:47.847881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:47.847881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:47.847881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:47.847881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:42:47.847881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:42:47.847881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 17:42:47.847881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Aug 24 17:42:47.847881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-0750e162-fc94-4d46-bb43-dad2d3e282be admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:42:47.848948 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-0750e162-fc94-4d46-bb43-dad2d3e282be admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015248 Aug 24 17:42:47.848948 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 22/42] 10.222.0.76 () {60 vars in 1190 bytes} [Wed Aug 24 17:42:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 17:42:48.817839 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-583a0d1f-30e1-4060-a6d4-f2e0ba86bee2 admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:48.819277 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-583a0d1f-30e1-4060-a6d4-f2e0ba86bee2 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Aug 24 17:42:48.819692 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 21/43] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 17:42:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:49.371209 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-38a3b276-f6e9-4b35-91be-b66f88c3ca1c admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:49.376511 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.wsgi [None req-38a3b276-f6e9-4b35-91be-b66f88c3ca1c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-38a3b276-f6e9-4b35-91be-b66f88c3ca1c admin admin] Request method failure captured: Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Accept: application/json Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Accept-Encoding: gzip, deflate Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Connection: keep-alive Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Content-Length: 0 Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Host: 10.222.0.76 Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Openstack-Api-Version: compute 2.90 Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Openstack-System-Scope: None Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: User-Agent: python-novaclient Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Auth-Token: gAAAAABjBmMYd9PBkCvGFqKVymnwGPN3jidTJsu2xmFKm2TQulAfokfTlGbbUXpv3vu2yUoJa6s_GNUyJfCv6rBfIDQgw5QEJolrGlnQlCZcmOmL-TPjQfgjdg5it1GyH9UsU_Kf079s5Daoz1vT53BZtuA2Ab_iKxSuZF08KWvKZn7uiwxunJ0 Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Domain-Id: None Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Domain-Name: None Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Identity-Status: Confirmed Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Is-Admin-Project: True Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Project-Domain-Id: default Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Project-Domain-Name: Default Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Project-Id: 74aebe409e204672bb76c767e1d15f99 Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Project-Name: admin Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Role: reader,member,admin Aug 24 17:42:49.378086 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Roles: reader,member,admin Aug 24 17:42:49.379716 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/74aebe409e204672bb76c767e1d15f99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74aebe409e204672bb76c767e1d15f99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_74aebe409e204672bb76c767e1d15f99", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74aebe409e204672bb76c767e1d15f99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:42:49.379716 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Tenant: admin Aug 24 17:42:49.379716 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Tenant-Id: 74aebe409e204672bb76c767e1d15f99 Aug 24 17:42:49.379716 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Tenant-Name: admin Aug 24 17:42:49.379716 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-User: admin Aug 24 17:42:49.379716 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-User-Domain-Id: default Aug 24 17:42:49.379716 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-User-Domain-Name: Default Aug 24 17:42:49.379716 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-User-Id: 9c52ecdd884449e5b0fb195998b79885 Aug 24 17:42:49.379716 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-User-Name: admin Aug 24 17:42:49.379716 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: method: > Aug 24 17:42:49.379716 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: exception: Flavor 84 could not be found. Aug 24 17:42:49.379716 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: action_args: {'id': '84'} Aug 24 17:42:49.379716 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:42:49.379716 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:49.380700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:42:49.380700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:42:49.380700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:42:49.380700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:42:49.380700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:42:49.380700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:42:49.380700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:42:49.380700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:42:49.380700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:42:49.380700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:49.380700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:42:49.380700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:42:49.380700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 17:42:49.380700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Aug 24 17:42:49.380700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:49.380700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Aug 24 17:42:49.380700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:49.380700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:49.380700 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:49.382124 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:42:49.382124 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:42:49.382124 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:42:49.382124 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:49.382124 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:42:49.382124 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:42:49.382124 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 17:42:49.382124 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Aug 24 17:42:49.382124 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:49.382124 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Aug 24 17:42:49.382124 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:49.382124 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:49.382124 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:49.382124 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:42:49.382124 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:42:49.382124 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 17:42:49.382124 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Aug 24 17:42:49.382124 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-38a3b276-f6e9-4b35-91be-b66f88c3ca1c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:42:49.383387 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-38a3b276-f6e9-4b35-91be-b66f88c3ca1c admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.419823 Aug 24 17:42:49.383387 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 23/44] 10.222.0.76 () {60 vars in 1190 bytes} [Wed Aug 24 17:42:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 421 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 17:42:49.390198 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-dcc367a4-55bd-4b71-b267-766018949af2 admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:49.405652 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-dcc367a4-55bd-4b71-b267-766018949af2 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020059 Aug 24 17:42:49.406247 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 22/45] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Aug 24 17:42:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:42:49.415929 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-b6b63322-930c-4adf-8cbb-660717ce7fb6 admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:49.431865 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-b6b63322-930c-4adf-8cbb-660717ce7fb6 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019417 Aug 24 17:42:49.432412 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 24/46] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Aug 24 17:42:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:42:49.442676 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-9ab26ffe-e691-4934-b5b5-2b9310a54b63 admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:49.448049 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.wsgi [None req-9ab26ffe-e691-4934-b5b5-2b9310a54b63 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-9ab26ffe-e691-4934-b5b5-2b9310a54b63 admin admin] Request method failure captured: Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Accept: application/json Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Accept-Encoding: gzip, deflate Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Connection: keep-alive Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Content-Length: 0 Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Host: 10.222.0.76 Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Openstack-Api-Version: compute 2.90 Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Openstack-System-Scope: None Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: User-Agent: python-novaclient Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Auth-Token: gAAAAABjBmMYd9PBkCvGFqKVymnwGPN3jidTJsu2xmFKm2TQulAfokfTlGbbUXpv3vu2yUoJa6s_GNUyJfCv6rBfIDQgw5QEJolrGlnQlCZcmOmL-TPjQfgjdg5it1GyH9UsU_Kf079s5Daoz1vT53BZtuA2Ab_iKxSuZF08KWvKZn7uiwxunJ0 Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Domain-Id: None Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Domain-Name: None Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Identity-Status: Confirmed Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Is-Admin-Project: True Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Project-Domain-Id: default Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Project-Domain-Name: Default Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Project-Id: 74aebe409e204672bb76c767e1d15f99 Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Project-Name: admin Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Role: reader,member,admin Aug 24 17:42:49.450336 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Roles: reader,member,admin Aug 24 17:42:49.451865 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/74aebe409e204672bb76c767e1d15f99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74aebe409e204672bb76c767e1d15f99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_74aebe409e204672bb76c767e1d15f99", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74aebe409e204672bb76c767e1d15f99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:42:49.451865 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Tenant: admin Aug 24 17:42:49.451865 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Tenant-Id: 74aebe409e204672bb76c767e1d15f99 Aug 24 17:42:49.451865 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Tenant-Name: admin Aug 24 17:42:49.451865 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-User: admin Aug 24 17:42:49.451865 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-User-Domain-Id: default Aug 24 17:42:49.451865 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-User-Domain-Name: Default Aug 24 17:42:49.451865 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-User-Id: 9c52ecdd884449e5b0fb195998b79885 Aug 24 17:42:49.451865 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-User-Name: admin Aug 24 17:42:49.451865 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: method: > Aug 24 17:42:49.451865 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: exception: Flavor 84 could not be found. Aug 24 17:42:49.451865 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: action_args: {'id': '84'} Aug 24 17:42:49.451865 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:42:49.451865 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:49.452846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:42:49.452846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:42:49.452846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:42:49.452846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:42:49.452846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:42:49.452846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:42:49.452846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:42:49.452846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:42:49.452846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:42:49.452846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:49.452846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:42:49.452846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:42:49.452846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 17:42:49.452846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Aug 24 17:42:49.452846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:49.452846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Aug 24 17:42:49.452846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:49.452846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:49.452846 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:49.454189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:42:49.454189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:42:49.454189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:42:49.454189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:49.454189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:42:49.454189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:42:49.454189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 17:42:49.454189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Aug 24 17:42:49.454189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:49.454189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Aug 24 17:42:49.454189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:49.454189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:49.454189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:49.454189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:42:49.454189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:42:49.454189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 17:42:49.454189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Aug 24 17:42:49.454189 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-9ab26ffe-e691-4934-b5b5-2b9310a54b63 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:42:49.455374 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-9ab26ffe-e691-4934-b5b5-2b9310a54b63 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013319 Aug 24 17:42:49.455374 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 23/47] 10.222.0.76 () {60 vars in 1190 bytes} [Wed Aug 24 17:42:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 17:42:50.462770 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-b6b63322-930c-4adf-8cbb-660717ce7fb6 admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:50.463758 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-b6b63322-930c-4adf-8cbb-660717ce7fb6 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 24 17:42:50.464210 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 25/48] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 17:42:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:51.023626 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-631ab8e3-c81a-4cf1-90a8-44cb0399171f admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:51.030368 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.wsgi [None req-631ab8e3-c81a-4cf1-90a8-44cb0399171f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-631ab8e3-c81a-4cf1-90a8-44cb0399171f admin admin] Request method failure captured: Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Accept: application/json Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Accept-Encoding: gzip, deflate Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Connection: keep-alive Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Content-Length: 0 Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Host: 10.222.0.76 Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Openstack-Api-Version: compute 2.90 Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Openstack-System-Scope: None Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: User-Agent: python-novaclient Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Auth-Token: gAAAAABjBmMaZ0E3GVb_wWfqyaj_rzBG-ePMSxKPQronOtPiwzx7Ven-cvWpfW4NZi3HYznntgwm3gzs6YYpmmCZw1V1D78y0UQToM3s8Iq4tThb7MP8fS-pk1jHzwZBUTZOor8NgykqY7K2AYciAnDQmXmvffgA-tiofD6I-MNxZusgiGtpe7Q Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Domain-Id: None Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Domain-Name: None Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Identity-Status: Confirmed Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Is-Admin-Project: True Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Project-Domain-Id: default Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Project-Domain-Name: Default Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Project-Id: 74aebe409e204672bb76c767e1d15f99 Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Project-Name: admin Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Role: reader,member,admin Aug 24 17:42:51.031943 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Roles: reader,member,admin Aug 24 17:42:51.033555 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/74aebe409e204672bb76c767e1d15f99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74aebe409e204672bb76c767e1d15f99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_74aebe409e204672bb76c767e1d15f99", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74aebe409e204672bb76c767e1d15f99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:42:51.033555 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Tenant: admin Aug 24 17:42:51.033555 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Tenant-Id: 74aebe409e204672bb76c767e1d15f99 Aug 24 17:42:51.033555 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-Tenant-Name: admin Aug 24 17:42:51.033555 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-User: admin Aug 24 17:42:51.033555 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-User-Domain-Id: default Aug 24 17:42:51.033555 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-User-Domain-Name: Default Aug 24 17:42:51.033555 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-User-Id: 9c52ecdd884449e5b0fb195998b79885 Aug 24 17:42:51.033555 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: X-User-Name: admin Aug 24 17:42:51.033555 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: method: > Aug 24 17:42:51.033555 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: exception: Flavor 451 could not be found. Aug 24 17:42:51.033555 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: action_args: {'id': '451'} Aug 24 17:42:51.033555 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:42:51.033555 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:51.035803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:42:51.035803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:42:51.035803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:42:51.035803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:42:51.035803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:42:51.035803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:42:51.035803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:42:51.035803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:42:51.035803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:42:51.035803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:51.035803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:42:51.035803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:42:51.035803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 17:42:51.035803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Aug 24 17:42:51.035803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:51.035803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Aug 24 17:42:51.035803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:51.035803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:51.035803 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:51.036889 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:42:51.036889 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:42:51.036889 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:42:51.036889 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:51.036889 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:42:51.036889 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:42:51.036889 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 17:42:51.036889 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Aug 24 17:42:51.036889 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:51.036889 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Aug 24 17:42:51.036889 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:51.036889 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:51.036889 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:51.036889 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:42:51.036889 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:42:51.036889 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 17:42:51.036889 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: ERROR nova.api.openstack.wsgi Aug 24 17:42:51.036889 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-631ab8e3-c81a-4cf1-90a8-44cb0399171f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:42:51.038028 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-631ab8e3-c81a-4cf1-90a8-44cb0399171f admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.430437 Aug 24 17:42:51.038028 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 24/49] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Aug 24 17:42:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 17:42:51.043717 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-0ffb4417-9480-4cc2-bb73-5f24a3de29d7 admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:51.058881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-0ffb4417-9480-4cc2-bb73-5f24a3de29d7 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019265 Aug 24 17:42:51.059434 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 26/50] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Aug 24 17:42:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:42:51.070384 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-cd1958f1-6e28-45af-ab02-90a036bc90c6 admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:51.085410 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-cd1958f1-6e28-45af-ab02-90a036bc90c6 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019915 Aug 24 17:42:51.085983 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 25/51] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Aug 24 17:42:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:42:51.096054 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-724aa63d-be53-4bac-9308-aded9a3ef796 admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:51.101485 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.wsgi [None req-724aa63d-be53-4bac-9308-aded9a3ef796 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-724aa63d-be53-4bac-9308-aded9a3ef796 admin admin] Request method failure captured: Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Accept: application/json Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Accept-Encoding: gzip, deflate Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Connection: keep-alive Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Content-Length: 0 Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Host: 10.222.0.76 Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Openstack-Api-Version: compute 2.90 Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Openstack-System-Scope: None Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: User-Agent: python-novaclient Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Auth-Token: gAAAAABjBmMaZ0E3GVb_wWfqyaj_rzBG-ePMSxKPQronOtPiwzx7Ven-cvWpfW4NZi3HYznntgwm3gzs6YYpmmCZw1V1D78y0UQToM3s8Iq4tThb7MP8fS-pk1jHzwZBUTZOor8NgykqY7K2AYciAnDQmXmvffgA-tiofD6I-MNxZusgiGtpe7Q Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Domain-Id: None Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Domain-Name: None Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Identity-Status: Confirmed Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Is-Admin-Project: True Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Project-Domain-Id: default Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Project-Domain-Name: Default Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Project-Id: 74aebe409e204672bb76c767e1d15f99 Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Project-Name: admin Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Role: reader,member,admin Aug 24 17:42:51.103011 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Roles: reader,member,admin Aug 24 17:42:51.104551 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/74aebe409e204672bb76c767e1d15f99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74aebe409e204672bb76c767e1d15f99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_74aebe409e204672bb76c767e1d15f99", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/74aebe409e204672bb76c767e1d15f99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:42:51.104551 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Tenant: admin Aug 24 17:42:51.104551 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Tenant-Id: 74aebe409e204672bb76c767e1d15f99 Aug 24 17:42:51.104551 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-Tenant-Name: admin Aug 24 17:42:51.104551 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-User: admin Aug 24 17:42:51.104551 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-User-Domain-Id: default Aug 24 17:42:51.104551 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-User-Domain-Name: Default Aug 24 17:42:51.104551 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-User-Id: 9c52ecdd884449e5b0fb195998b79885 Aug 24 17:42:51.104551 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: X-User-Name: admin Aug 24 17:42:51.104551 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: method: > Aug 24 17:42:51.104551 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: exception: Flavor 451 could not be found. Aug 24 17:42:51.104551 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: action_args: {'id': '451'} Aug 24 17:42:51.104551 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:42:51.104551 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:51.106078 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:42:51.106078 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:42:51.106078 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:42:51.106078 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:42:51.106078 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:42:51.106078 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:42:51.106078 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:42:51.106078 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:42:51.106078 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:42:51.106078 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:51.106078 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:42:51.106078 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:42:51.106078 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 17:42:51.106078 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Aug 24 17:42:51.106078 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:51.106078 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Aug 24 17:42:51.106078 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:51.106078 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:51.106078 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:51.107281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:42:51.107281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:42:51.107281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:42:51.107281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:51.107281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:42:51.107281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:42:51.107281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 17:42:51.107281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Aug 24 17:42:51.107281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:51.107281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Aug 24 17:42:51.107281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:51.107281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:51.107281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:51.107281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:42:51.107281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:42:51.107281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 17:42:51.107281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: ERROR nova.api.openstack.wsgi Aug 24 17:42:51.107281 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-724aa63d-be53-4bac-9308-aded9a3ef796 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:42:51.108630 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-724aa63d-be53-4bac-9308-aded9a3ef796 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011921 Aug 24 17:42:51.108630 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 27/52] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Aug 24 17:42:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 17:42:52.106387 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-cd1958f1-6e28-45af-ab02-90a036bc90c6 admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:52.107414 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-cd1958f1-6e28-45af-ab02-90a036bc90c6 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002313 Aug 24 17:42:52.107811 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 26/53] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 17:42:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:52.646110 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-5a0aa812-8efc-4a7a-b87c-c181be1af1e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:52.716507 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-5a0aa812-8efc-4a7a-b87c-c181be1af1e3 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.467677 Aug 24 17:42:52.717066 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 28/54] 10.222.0.76 () {64 vars in 1235 bytes} [Wed Aug 24 17:42:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:42:53.717029 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-cd1958f1-6e28-45af-ab02-90a036bc90c6 admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:53.718100 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-cd1958f1-6e28-45af-ab02-90a036bc90c6 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 24 17:42:53.718545 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 27/55] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 17:42:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:54.269662 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-7b030ced-da1d-4689-a20d-8f47ad7b8e11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:54.332908 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-7b030ced-da1d-4689-a20d-8f47ad7b8e11 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.469679 Aug 24 17:42:54.333463 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 29/56] 10.222.0.76 () {64 vars in 1235 bytes} [Wed Aug 24 17:42:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:42:55.329170 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-cd1958f1-6e28-45af-ab02-90a036bc90c6 admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:55.330237 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-cd1958f1-6e28-45af-ab02-90a036bc90c6 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 24 17:42:55.330643 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 28/57] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 17:42:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:55.869024 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-90654716-7f6c-4f50-a038-5ea5ae7bf40d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:55.951218 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-90654716-7f6c-4f50-a038-5ea5ae7bf40d admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.481605 Aug 24 17:42:55.951771 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 30/58] 10.222.0.76 () {64 vars in 1235 bytes} [Wed Aug 24 17:42:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:42:56.942453 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-cd1958f1-6e28-45af-ab02-90a036bc90c6 admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:56.943486 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-cd1958f1-6e28-45af-ab02-90a036bc90c6 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 24 17:42:56.943895 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 29/59] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 17:42:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:57.488413 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-37c59475-b5b8-477a-b03a-2c5971fed534 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:57.550949 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-37c59475-b5b8-477a-b03a-2c5971fed534 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.465997 Aug 24 17:42:57.551521 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 31/60] 10.222.0.76 () {64 vars in 1235 bytes} [Wed Aug 24 17:42:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:42:58.552950 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-cd1958f1-6e28-45af-ab02-90a036bc90c6 admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:58.554001 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-cd1958f1-6e28-45af-ab02-90a036bc90c6 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 24 17:42:58.554393 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 30/61] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 17:42:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:59.088335 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-4fac9e9c-e2b8-4619-8441-dfe1d0c9243f admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:59.109180 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-4fac9e9c-e2b8-4619-8441-dfe1d0c9243f admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.417372 Aug 24 17:42:59.109731 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 32/62] 10.222.0.76 () {60 vars in 1202 bytes} [Wed Aug 24 17:42:58 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:43:53.442947 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-cd1958f1-6e28-45af-ab02-90a036bc90c6 admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:53.443909 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-cd1958f1-6e28-45af-ab02-90a036bc90c6 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 24 17:43:53.444346 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 31/63] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 17:43:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:43:53.456838 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG dbcounter [-] [112626] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:43:53.874154 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-7ac4f414-69b5-4e6f-a3f9-b9c490722c48 admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:53.895861 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-7ac4f414-69b5-4e6f-a3f9-b9c490722c48 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.443631 Aug 24 17:43:53.896415 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 33/64] 10.222.0.76 () {60 vars in 1292 bytes} [Wed Aug 24 17:43:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:43:53.918703 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG dbcounter [-] [112625] Writing DB stats nova_api:SELECT=14 {{(pid=112625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:43:53.922551 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-a24f6d3b-6dc3-4218-a70b-627a4876e64d admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:53.930569 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-a24f6d3b-6dc3-4218-a70b-627a4876e64d admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013309 Aug 24 17:43:53.930895 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 32/65] 10.222.0.76 () {60 vars in 1283 bytes} [Wed Aug 24 17:43:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:43:53.942975 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-f115c376-5341-460d-ba70-915d78dbf755 admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:53.951964 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-f115c376-5341-460d-ba70-915d78dbf755 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012516 Aug 24 17:43:53.952443 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 34/66] 10.222.0.76 () {60 vars in 1286 bytes} [Wed Aug 24 17:43:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:53.965495 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-04832122-1d8e-49e7-badf-f43666ee976d admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:53.973430 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-04832122-1d8e-49e7-badf-f43666ee976d admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012645 Aug 24 17:43:53.973997 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 33/67] 10.222.0.76 () {60 vars in 1286 bytes} [Wed Aug 24 17:43:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:53.989533 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-1acbb5e1-26d2-4d1c-8a67-f9a53699fa11 admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:53.998301 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-1acbb5e1-26d2-4d1c-8a67-f9a53699fa11 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015789 Aug 24 17:43:53.998881 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 35/68] 10.222.0.76 () {60 vars in 1283 bytes} [Wed Aug 24 17:43:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:47:05.248783 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-04832122-1d8e-49e7-badf-f43666ee976d admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:05.249843 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-04832122-1d8e-49e7-badf-f43666ee976d admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 24 17:47:05.257084 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 34/69] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 17:47:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:47:05.404810 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG dbcounter [-] [112626] Writing DB stats nova_api:SELECT=6 {{(pid=112626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:05.598777 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-9cc51945-55ad-4c46-97ae-1a3239567d64 admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:05.601190 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:47:05.601190 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: warnings.warn(msg) Aug 24 17:47:05.602440 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-9cc51945-55ad-4c46-97ae-1a3239567d64 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:05.602921 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-9cc51945-55ad-4c46-97ae-1a3239567d64 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:05.603347 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-9cc51945-55ad-4c46-97ae-1a3239567d64 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:05.604304 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-9cc51945-55ad-4c46-97ae-1a3239567d64 admin admin] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:05.604748 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-9cc51945-55ad-4c46-97ae-1a3239567d64 admin admin] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:05.605255 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-9cc51945-55ad-4c46-97ae-1a3239567d64 admin admin] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:05.642516 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-9cc51945-55ad-4c46-97ae-1a3239567d64 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.245791 Aug 24 17:47:05.643289 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 36/70] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Aug 24 17:47:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:47:06.538197 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-04832122-1d8e-49e7-badf-f43666ee976d admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:06.539324 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-04832122-1d8e-49e7-badf-f43666ee976d admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001660 Aug 24 17:47:06.539806 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 35/71] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 17:47:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:47:06.757347 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-f53a7dc1-659f-4560-a6cd-676ce759aa54 admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:06.761539 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:47:06.761539 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: warnings.warn(msg) Aug 24 17:47:06.762971 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-f53a7dc1-659f-4560-a6cd-676ce759aa54 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:06.763485 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-f53a7dc1-659f-4560-a6cd-676ce759aa54 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:06.763986 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-f53a7dc1-659f-4560-a6cd-676ce759aa54 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:06.764761 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-f53a7dc1-659f-4560-a6cd-676ce759aa54 admin admin] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:06.765203 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-f53a7dc1-659f-4560-a6cd-676ce759aa54 admin admin] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:06.765696 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-f53a7dc1-659f-4560-a6cd-676ce759aa54 admin admin] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:06.786741 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-f53a7dc1-659f-4560-a6cd-676ce759aa54 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.100775 Aug 24 17:47:06.787329 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 37/72] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Aug 24 17:47:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:47:18.131274 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-04832122-1d8e-49e7-badf-f43666ee976d admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:18.132312 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-04832122-1d8e-49e7-badf-f43666ee976d admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 24 17:47:18.132786 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 36/73] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 17:47:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:47:18.279206 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG dbcounter [-] [112626] Writing DB stats nova_cell0:SELECT=4 {{(pid=112626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:18.279927 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG dbcounter [-] [112626] Writing DB stats nova_cell1:SELECT=4 {{(pid=112626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:18.280551 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG dbcounter [-] [112626] Writing DB stats nova_api:SELECT=8 {{(pid=112626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:18.334173 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-d2ae0f2f-6b5c-4482-b609-13c4603d8c9d admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:18.336698 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:47:18.336698 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: warnings.warn(msg) Aug 24 17:47:18.337994 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-d2ae0f2f-6b5c-4482-b609-13c4603d8c9d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:18.338477 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-d2ae0f2f-6b5c-4482-b609-13c4603d8c9d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:18.338905 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-d2ae0f2f-6b5c-4482-b609-13c4603d8c9d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:18.339657 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-d2ae0f2f-6b5c-4482-b609-13c4603d8c9d admin admin] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:18.340098 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-d2ae0f2f-6b5c-4482-b609-13c4603d8c9d admin admin] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:18.340511 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-d2ae0f2f-6b5c-4482-b609-13c4603d8c9d admin admin] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:18.368466 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-d2ae0f2f-6b5c-4482-b609-13c4603d8c9d admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.093582 Aug 24 17:47:18.369060 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 38/74] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Aug 24 17:47:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:47:19.215979 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: DEBUG nova.api.openstack.wsgi [None req-04832122-1d8e-49e7-badf-f43666ee976d admin admin] Calling method '>' {{(pid=112625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:19.217000 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: INFO nova.api.openstack.requestlog [None req-04832122-1d8e-49e7-badf-f43666ee976d admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 24 17:47:19.217407 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: [pid: 112625|app: 0|req: 37/75] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 17:47:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:47:19.415167 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG nova.api.openstack.wsgi [None req-13410347-cdba-457b-a454-84087ca705d7 admin admin] Calling method '>' {{(pid=112626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:19.417546 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:47:19.417546 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: warnings.warn(msg) Aug 24 17:47:19.418677 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-13410347-cdba-457b-a454-84087ca705d7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:19.419150 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-13410347-cdba-457b-a454-84087ca705d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:19.419567 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-13410347-cdba-457b-a454-84087ca705d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:19.420275 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-13410347-cdba-457b-a454-84087ca705d7 admin admin] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:19.420764 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-13410347-cdba-457b-a454-84087ca705d7 admin admin] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:19.421126 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: DEBUG oslo_concurrency.lockutils [None req-13410347-cdba-457b-a454-84087ca705d7 admin admin] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:19.443423 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: INFO nova.api.openstack.requestlog [None req-13410347-cdba-457b-a454-84087ca705d7 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083252 Aug 24 17:47:19.443998 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: [pid: 112626|app: 0|req: 39/76] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Aug 24 17:47:19 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:15.981200 dv-cinder-854428-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 17:48:15.982398 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: Wed Aug 24 17:48:15 2022 - graceful shutdown triggered... Aug 24 17:48:15.982892 dv-cinder-854428-1-iscsi devstack@n-api.service[112625]: Gracefully killing worker 1 (pid: 112625)... Aug 24 17:48:15.983260 dv-cinder-854428-1-iscsi devstack@n-api.service[112626]: Gracefully killing worker 2 (pid: 112626)... Aug 24 17:48:16.983537 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: worker 1 buried after 1 seconds Aug 24 17:48:16.983941 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: worker 2 buried after 1 seconds Aug 24 17:48:16.983941 dv-cinder-854428-1-iscsi devstack@n-api.service[112624]: goodbye to uWSGI. Aug 24 17:48:16.985165 dv-cinder-854428-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 17:48:16.985765 dv-cinder-854428-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 17:48:16.988821 dv-cinder-854428-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 17:48:17.001806 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 17:48:17.004618 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 17:48:17 2022] *** Aug 24 17:48:17.004618 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 17:48:17.004618 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 17:48:17.004618 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: nodename: dv-cinder-854428-1-iscsi Aug 24 17:48:17.004618 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: machine: x86_64 Aug 24 17:48:17.004618 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: clock source: unix Aug 24 17:48:17.004618 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: pcre jit disabled Aug 24 17:48:17.004618 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: detected number of CPU cores: 4 Aug 24 17:48:17.004618 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: current working directory: / Aug 24 17:48:17.004618 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: detected binary path: /usr/bin/uwsgi-core Aug 24 17:48:17.005407 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: your processes number limit is 47680 Aug 24 17:48:17.005407 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: your memory page size is 4096 bytes Aug 24 17:48:17.005407 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: detected max file descriptor number: 2048 Aug 24 17:48:17.005407 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: lock engine: pthread robust mutexes Aug 24 17:48:17.005407 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: thunder lock: enabled Aug 24 17:48:17.005407 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 17:48:17.005407 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 17:48:17.047110 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: Python main interpreter initialized at 0x55b7f7c989c0 Aug 24 17:48:17.047110 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: python threads support enabled Aug 24 17:48:17.047110 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: your server socket listen backlog is limited to 100 connections Aug 24 17:48:17.047110 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: your mercy for graceful operations on workers is 90 seconds Aug 24 17:48:17.047536 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 17:48:17.047608 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: *** Operational MODE: preforking *** Aug 24 17:48:17.047886 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: *** uWSGI is running in multiple interpreter mode *** Aug 24 17:48:17.047886 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: spawned uWSGI master process (pid: 127660) Aug 24 17:48:17.048101 dv-cinder-854428-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 17:48:17.049056 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: spawned uWSGI worker 1 (pid: 127676, cores: 1) Aug 24 17:48:17.049056 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: spawned uWSGI worker 2 (pid: 127677, cores: 1) Aug 24 17:48:17.049293 dv-cinder-854428-1-iscsi devstack@n-api.service[127660]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 17:48:17.731921 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 17:48:17.744754 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 17:48:18.956409 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:48:18.956409 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: from cryptography.utils import int_from_bytes Aug 24 17:48:18.957324 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:48:18.957324 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: from cryptography.utils import int_from_bytes Aug 24 17:48:18.978132 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:48:18.978132 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: from cryptography.utils import int_from_bytes Aug 24 17:48:18.978943 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:48:18.978943 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: from cryptography.utils import int_from_bytes Aug 24 17:48:21.505339 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 17:48:21.506878 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 17:48:21.507060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 17:48:21.507506 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 17:48:21.507673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 17:48:21.508000 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.508341 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.508679 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.509006 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.509508 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.509842 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.510189 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.510533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.510851 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.511123 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.511448 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.511784 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854428-1-iscsi {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.512132 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.512429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.512749 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.513251 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.513520 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.513767 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.514064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.514513 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.516097 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.516459 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.516750 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.517108 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.517443 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.517744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.518115 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.518415 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.521437 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.521437 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.521437 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854428-1-iscsi {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.521437 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.521437 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.521437 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.521437 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.521437 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.523649 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.523649 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.523649 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.523649 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.524675 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 17:48:21.525333 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.525514 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 17:48:21.525713 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.525713 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.526138 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 17:48:21.526361 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.526529 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 17:48:21.526684 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.526831 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 17:48:21.527094 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.527333 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.527496 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.527722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.527876 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.528034 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.528179 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.528179 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.529593 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.529963 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.530176 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.530338 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.530492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.530648 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.530867 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.531228 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.531528 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.531755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.531994 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.532229 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.532229 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.532672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.532672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.533415 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.533660 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854428-1-iscsi {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.534033 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.534033 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.534517 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.534769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.535025 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.535270 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.535523 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.535769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.536000 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.536241 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.536476 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.536717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.536980 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.537225 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.537486 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.537734 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.538024 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.538314 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.538562 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.540328 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.540592 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.540825 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.541085 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.541347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.541670 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.541952 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.542212 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.542444 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.542692 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.542944 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.543193 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.543352 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.543534 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.543778 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.544031 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.544262 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.544262 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.544740 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.544987 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.545521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854428-1-iscsi {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.545769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.546054 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.546305 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.546548 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.546812 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.546812 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.547386 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.547630 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.547866 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.548118 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.548389 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.549154 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.550779 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.551038 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.551038 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.551605 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.551860 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.552111 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.552357 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.553085 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.553317 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.553558 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.553811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.554108 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.554266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.554424 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.554607 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.554854 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.555096 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.555096 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.555546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.555773 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.556013 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.556256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.556505 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.556750 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.557067 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.557294 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.557535 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.557798 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.558137 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.558327 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.558478 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.558624 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.558788 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.559033 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.559563 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.561100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.561402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.561726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.562011 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.562373 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.562621 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.562860 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.563102 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.563364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.563585 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.563799 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.564026 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.564273 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.564532 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.564771 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.565059 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.565059 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.565516 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.565762 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.566085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.566085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.566541 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.566541 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.567018 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.567448 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.567713 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.567956 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.569106 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.569303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.569643 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.569843 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.570286 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.570926 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.571211 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.571400 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.571726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.571939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.572175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.572422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.572673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.572856 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.573026 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.573226 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.573449 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.573668 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.573924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.574116 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.574355 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.574579 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.574780 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.575005 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.575246 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.575480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.575713 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.575939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.576154 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.576388 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.576636 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.576879 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.577099 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.577327 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.577557 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.577804 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.578159 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.578422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.578661 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.578661 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.578661 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.579314 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.579314 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.580192 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.581543 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.582038 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.582301 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.582556 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.582806 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.583069 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.583314 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.583548 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.583838 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.584080 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.584341 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.584600 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.585017 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.585248 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.585248 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.585722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.586083 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.586348 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.586593 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.586822 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.587061 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.587302 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.587543 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.587784 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.588009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.588235 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.588467 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.588688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.588931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.589219 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.589453 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.589688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.589944 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.590197 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.590459 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.591023 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.592328 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.592583 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.592828 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.593086 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.593333 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.593580 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.593839 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.594161 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.594161 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.594796 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.594796 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.595247 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.595511 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.595756 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.595756 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.596227 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.596227 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.596681 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.596924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.597166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.597434 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.597674 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.597962 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.598226 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.598465 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.598673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.598886 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.599115 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.599353 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.599648 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.599807 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.599963 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.600117 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.600286 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.600433 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.600589 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.600735 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.601137 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.601434 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.602146 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.602334 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.602629 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.602790 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.602945 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.603098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.603251 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.603419 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.603581 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.603741 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.603887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.604040 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.604187 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.604340 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.604340 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.604340 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.604782 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.604927 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.605080 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.605233 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.605481 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.605634 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.605788 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.606000 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.606155 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:48:21.606301 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.606455 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.606610 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.606766 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.606920 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.607065 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.607216 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.607382 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.607535 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.607756 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.607919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.608067 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.608219 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.608379 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.608525 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.608671 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.608815 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.608967 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.609126 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.609280 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.609435 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.609587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.609733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.609898 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.610067 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.610221 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.610367 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.610512 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.610715 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.610875 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.611054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.611448 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.611728 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.612388 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.612550 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.612855 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.613022 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.613169 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.613314 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.613467 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.613620 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.613775 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.613986 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.614136 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.614288 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.614446 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.614598 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.614754 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.614899 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.614899 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.615696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.615856 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.616006 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.616006 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.616299 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.616299 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.616573 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.616724 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.616896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.617043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.617195 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.617195 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.617470 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.617470 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.617766 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.617931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.618092 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.618239 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.618384 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.618535 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.618688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.618845 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.618990 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.619133 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.619278 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.619422 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.619580 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.619740 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.619893 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.620046 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.620192 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.620344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.620344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.620344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.620785 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.620929 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.620929 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.621220 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.621598 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.622003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.622640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.622804 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.623098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.623261 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.623416 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.623562 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.623719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.623863 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.624016 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.624171 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.624324 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.624324 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.624601 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.624745 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.624889 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.625042 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.625188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.625340 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.625494 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.625649 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.625814 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.626036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.626036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.626313 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.626457 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.626602 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.626763 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.626917 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.627062 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.627215 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.627366 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.627519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.627693 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.627839 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.627983 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.628127 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.628279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.628439 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.628593 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.628593 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.628868 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.628868 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.629190 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.629344 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.629499 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.629654 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.629799 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.629968 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.630162 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.630162 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.630459 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.630605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.631310 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.631496 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.631868 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.632144 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.632442 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.632969 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.633144 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.633428 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.633595 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.633757 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.633952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.634109 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.634260 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.634423 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.634575 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.634737 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.634890 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.635053 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.635225 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.635377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.635537 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.635698 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.635867 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.636021 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.636172 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.636323 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.636482 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.636634 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.636793 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.636793 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.636793 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.636793 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.636793 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.637537 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.637696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.637696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.638038 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.638201 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.638201 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.638583 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.638743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.638743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.639038 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.639200 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.639200 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.639506 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.639665 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.639665 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.639952 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.640112 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.640272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.640424 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.640424 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.640717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.640877 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.640877 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.641197 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.641350 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.641350 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.641637 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.641807 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.641807 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.642636 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.643869 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.643869 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.644184 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.644340 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.644506 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.644670 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.644670 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.645029 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.645183 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.645183 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.645471 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.645632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.645632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.645972 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.646155 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.646484 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.646659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.646659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.646986 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.647212 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.647212 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.647518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.647679 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.647841 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.648000 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.648000 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.648287 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.648444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.648444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.648755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.649056 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.649056 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.649376 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.649528 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.649528 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.649825 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.650036 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.650036 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.650350 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.650502 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.650668 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.650822 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.650822 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.650822 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.651279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.651438 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.651438 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.651736 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.651888 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.651888 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.652521 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.652792 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.652792 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.653531 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.653686 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.653686 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.654166 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.654334 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.654497 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.654650 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.654650 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.654948 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.655108 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.655108 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.655108 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.655550 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.655708 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.655708 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.656040 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.656466 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.656466 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.656788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.656950 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.656950 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.657253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.657419 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.657732 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.657830 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.657830 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.658028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.658560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.658560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.658758 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.658848 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.658848 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.659012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.659114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.659114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.659288 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.659383 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.659471 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.659557 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.659557 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.659729 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.659825 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.659825 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.659979 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.660065 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.660065 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.660240 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.660335 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.660335 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.660489 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.660584 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.660584 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.660753 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.660845 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.660932 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.661017 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.661017 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.661017 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.661370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.661485 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.661485 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.661658 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.661754 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.661754 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.662037 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.662153 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.662153 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.662452 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.662815 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.662815 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.662815 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.663567 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.663664 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.663664 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.663873 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.663971 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.663971 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.664116 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.664219 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.664219 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.664388 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.664476 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.664476 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.664634 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.664817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.664912 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.664999 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.665072 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.665156 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.665236 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.665331 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.665426 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.665526 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.665622 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.665713 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.665801 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.665891 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.665967 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.666063 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.666166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.666254 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.666347 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.666442 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.666612 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.666702 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.666795 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.666882 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.666968 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.667062 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.667149 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.667243 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.667330 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.667423 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.667516 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.667614 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.667715 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.667809 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.667895 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.667987 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.668074 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.668176 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.668264 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.668349 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.668349 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.668522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.668609 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.668691 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.668691 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.668854 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.668949 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.668949 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.669118 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.669219 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.669219 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.669219 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.669465 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.669559 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.669658 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.669746 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.669838 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.669994 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.670068 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.670139 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.670223 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.670312 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.670398 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.670483 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.670568 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.670652 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.670812 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.670901 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.670994 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.671087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.671174 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.671272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.671361 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.671442 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.671513 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.671597 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.671690 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.671790 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.671885 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.671885 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.672050 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.672122 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.672206 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.672300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.672387 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.672479 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.672573 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.672686 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.672796 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.672888 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.672975 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.673215 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.673300 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.673381 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.673494 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.673752 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.673845 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.673960 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.674048 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.674134 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.674229 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.674317 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.674410 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.674497 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.674591 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.674685 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.674782 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.674876 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.674970 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.675064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.675150 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.675230 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.675330 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.675418 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.675511 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.675597 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.675686 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.675782 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.675869 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.675963 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.676064 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.676197 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.676197 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.676379 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.676467 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.676467 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.676595 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.676680 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.676773 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.676868 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.676954 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.677038 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.677122 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.677214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.677308 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.677406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.678304 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.678407 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.678496 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.678765 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.678876 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.678954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.679027 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.679107 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.679189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.679264 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.679352 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.679428 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.679508 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.679582 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.679660 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.679740 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.679831 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.679912 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.679986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.680065 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.680139 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.680217 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.680299 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.680371 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.680443 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.680513 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.680591 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.680875 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.680955 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.681027 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.681097 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.681168 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.681247 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.681334 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.681408 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.681487 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.681560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.681640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.681714 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.681794 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.681903 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.681995 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.682079 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.682152 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.682224 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.682305 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.682385 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.682458 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.682530 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.682600 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.682685 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.682774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.682854 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.682934 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.683007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.683078 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.683377 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.683478 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.683554 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.683626 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.683932 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.684014 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.684098 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.684172 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.684252 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.684332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.684405 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.684477 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.684558 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.684631 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.684703 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.684774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.684845 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.684929 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.685004 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.685075 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.685148 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.685228 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.685301 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.685387 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.685469 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.685549 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.685636 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.685711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.685783 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.685885 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.685963 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.686048 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.686130 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.686210 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.686296 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.686379 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.686453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.686540 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.686614 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.686692 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.686692 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.686835 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.686915 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.686989 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.687072 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.687163 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.687250 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.687330 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.687410 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.687491 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.687563 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.687642 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.687724 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.687804 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.687877 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.687948 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.687948 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.688082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.688242 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.688318 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.688390 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.688469 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.688469 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.688469 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.688469 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.688820 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.688894 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.688966 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.689045 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.689131 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.689131 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.689260 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.689260 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.689404 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.689477 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.689556 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.689658 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.689754 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.689840 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.690045 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.690131 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.690230 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.690318 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.690402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.690493 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.690586 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.690672 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.690672 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.690672 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.690672 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.690672 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.691077 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.691173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.691268 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.691362 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.691449 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.691541 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.691634 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.691733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.691830 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.691918 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.692003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.692095 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.692181 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.692276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.692362 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.692447 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.692532 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.692624 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.692710 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.692807 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.692894 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.692979 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.693084 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.694305 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.694472 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.694656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.694742 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.694825 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.694907 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.694988 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.695071 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.695152 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.695225 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.695313 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.695398 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.695483 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.695578 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.695673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.695760 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.695845 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.695938 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.696027 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.696121 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.696215 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.696302 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.696387 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.696485 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.696581 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.696668 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.696754 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.696838 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.696923 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.697018 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.697018 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.697185 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.697271 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.697363 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.697455 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.697549 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.697636 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.697729 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.697816 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.697916 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.698027 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.698027 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.698199 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.698287 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.698372 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.698456 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.698553 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.698553 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.698715 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.698809 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.698896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.698988 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.699087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.699182 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.699268 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.699353 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.699445 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.699545 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.699632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.699726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.699813 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.699898 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.699983 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.700081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.700319 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.700413 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.700638 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.700742 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.700954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.701067 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.701264 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.701367 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.701578 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.701682 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.701939 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.702075 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.702291 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.702395 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.702583 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.702687 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.702905 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.703009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.703223 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.703318 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.703549 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.703650 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.703861 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.703976 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.704250 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.704349 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.704489 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.704591 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.704834 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.704933 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.705102 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.705198 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.705412 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.705513 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.705742 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.705844 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.706087 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.706200 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.706414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.706523 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.706750 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.706853 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.707086 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.707182 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.707401 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.707509 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.707737 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.707840 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.708069 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.708180 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.708391 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.708500 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.708713 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.708835 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.709824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.710099 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.710099 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.710276 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.710366 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.710452 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.710537 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.710623 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.711346 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.711449 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.711546 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.711634 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.711719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.711814 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.711911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.711999 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.712094 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.712181 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.712275 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.712410 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.712516 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.712619 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.712715 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.712803 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.712991 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.713092 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.713283 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.713379 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.713625 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.713726 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.713957 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.714094 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.714388 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.714520 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.714637 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.714784 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.714904 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.714982 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.715181 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.715287 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.715490 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.715584 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.715802 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.715909 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.716111 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.716214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.716441 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.716545 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.716752 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.716845 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.717072 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.717164 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.717386 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.717505 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.717701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.717804 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.718045 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.718139 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.718362 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.718467 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.718684 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.718786 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.719006 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.719100 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.719329 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.719432 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.719660 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.719911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.720044 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.720246 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.720340 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.720566 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.720670 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.720886 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.720981 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.721204 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.721312 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.721527 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.721630 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.721978 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.722087 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.722199 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.722302 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.722516 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.722726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.722825 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.722922 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.723132 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.723241 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.723462 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.723557 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.723788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.724062 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.724163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.724537 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.724790 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.724884 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.724960 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.725057 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.725156 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.725372 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.725461 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.725693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.725845 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.726040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.726250 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.726356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.726574 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.726676 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.726887 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.726991 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.727206 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.727302 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.727527 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.727623 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.727843 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.727953 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.728164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.728261 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.728482 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.728578 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.728800 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.728902 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.729117 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.729211 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.729437 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.729536 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.729753 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.729910 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.730114 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.730210 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.730433 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.730536 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.730762 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.730866 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.731103 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.731205 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.731422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.731528 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.731740 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.731841 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.732058 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.732151 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.732378 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.732556 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.732696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.732907 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.733009 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.733226 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.733320 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.733565 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.733660 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.733919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.734017 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.734251 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.734362 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.734574 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.734720 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.734897 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.734995 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.735224 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.735345 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.735538 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.735651 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.735847 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.735986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.736165 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.736276 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.736480 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.736713 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.736815 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.737040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.737134 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.737385 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.737490 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.737704 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.737797 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.738069 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.738184 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.738386 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.738481 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.738716 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.739011 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.739111 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.739375 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.739478 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.739693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.739786 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.740526 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.740631 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.740876 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.741068 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.741240 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.741334 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.741578 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.741690 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.741922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.742033 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.742226 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.742329 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.742540 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.742646 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.742868 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.743025 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.743181 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.743491 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.743595 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.743799 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.743903 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.744122 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.744261 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.744479 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.744694 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.744857 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.745007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.745157 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.745359 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.745571 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.745789 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.745983 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.746205 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.746375 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.746541 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.746693 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.746864 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.747077 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.747226 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.747375 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.747532 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.747684 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.747971 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.748152 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.748304 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.748457 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.748622 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.748711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.748798 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.748881 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.748967 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.749158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.749256 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.749358 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.749447 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.749534 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.749754 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.750227 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.750356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.750498 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.750596 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.750684 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.750684 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.750870 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.750870 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.751045 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.751164 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.751267 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.751449 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.751564 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.751768 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.751873 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.752082 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.752179 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.752406 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.752564 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.752711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.752873 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.753024 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.753134 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.753354 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.753675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.753675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.753902 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.753998 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.754280 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.754384 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.754634 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.754755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.755136 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.755318 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.755493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.755603 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.756271 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.756386 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.756465 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.756653 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.756828 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.757040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.757193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.757374 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.757527 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.757681 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.757824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.758024 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.758137 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.758342 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.758479 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.758659 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.758847 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.758980 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.759276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.759423 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.759600 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.759769 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.759916 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.760101 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.760216 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.760448 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.760544 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.760789 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.760885 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.761107 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.761210 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.761423 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.761517 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.761735 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.761829 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.762095 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.762200 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.762420 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.762515 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.762744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.762849 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.763064 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.763173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.763383 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.763485 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.763699 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.763879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.764013 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.764107 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.764332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.764436 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.764650 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.764783 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.764963 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.765082 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.765335 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.765445 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.765597 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.765701 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.765937 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.766046 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.766250 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.766360 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.766566 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.766684 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.766875 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.766988 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.767227 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.767385 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.767544 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.767694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.767867 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.768023 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.768179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.768333 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.768490 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.768633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.768813 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.768959 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.769134 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.769286 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.769438 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.769580 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.769776 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.769921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.770152 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.770338 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.770499 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.770602 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.770796 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.770907 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.771269 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.771402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.771483 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.771604 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.771746 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.771968 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.772073 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.772295 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.772393 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.772625 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.772721 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.772945 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.773050 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.773257 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.773402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.773569 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.773682 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.773896 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.774100 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.774284 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.774502 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.774728 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.774904 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.775071 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.775224 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.775406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.775570 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.775766 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.775942 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.776102 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.776242 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.776392 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.776559 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.776719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.776927 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.777031 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.777184 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.777288 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.777365 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.777503 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.777668 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.777831 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.778192 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.778347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.778495 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.778642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.778810 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.779031 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.779188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.779401 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.779567 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.779721 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.779899 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.780049 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.780202 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.780362 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.780533 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.780705 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.780874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.781040 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.781182 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.781333 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.781539 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.781708 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.781948 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.782121 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.782341 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.782536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.782695 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.782863 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.783380 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.783583 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.783891 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.784150 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.784353 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.784535 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.784691 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.784842 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.785005 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.785203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.785388 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.785558 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.785782 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.786003 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.786159 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.786331 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.786481 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.786651 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.786822 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.786988 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.787141 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.787290 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.787385 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.787518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.787625 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.787759 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.787864 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.787960 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.788083 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.788216 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.788311 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.788311 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.788473 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.788561 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.788659 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.788755 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.788755 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.788910 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.788983 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.789110 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.789219 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.789309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.789443 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.789549 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.789645 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.789742 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.789831 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.789960 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.789960 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.790156 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.790255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.790353 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.790579 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.790683 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.790905 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.791020 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.791226 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.791337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.791553 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.791661 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.791866 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.791969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.792183 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.792279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.792511 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.792606 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.792827 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.792921 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.793206 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.793318 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.793487 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.793591 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.793827 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.794048 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.794265 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.794416 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.794572 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.794721 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.794868 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.795037 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.795037 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 17:48:21.795410 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.795410 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.795709 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.796017 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.796350 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.796668 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.796999 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.797338 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.797686 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.798032 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.798387 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.798766 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.799091 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.799410 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.799723 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:48:21.799976 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 17:48:21.858046 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO dbcounter [None req-e314f8d8-0a88-43f9-8e4c-59faca2b0be4 None None] Registered counter for database nova_api Aug 24 17:48:21.862778 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO dbcounter [None req-57d6be0e-6032-4197-9320-4cfd578cc540 None None] Registered counter for database nova_api Aug 24 17:48:21.879160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_db.sqlalchemy.engines [None req-e314f8d8-0a88-43f9-8e4c-59faca2b0be4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:48:21.885171 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_db.sqlalchemy.engines [None req-57d6be0e-6032-4197-9320-4cfd578cc540 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:48:21.886785 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writer thread running {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:48:21.891795 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writer thread running {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:48:21.945011 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.context [None req-e314f8d8-0a88-43f9-8e4c-59faca2b0be4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6269e10f-dbf4-40a1-8167-ac8cb84bb97a(cell1) {{(pid=127676) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 17:48:21.949226 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e314f8d8-0a88-43f9-8e4c-59faca2b0be4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:21.949707 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e314f8d8-0a88-43f9-8e4c-59faca2b0be4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:21.950061 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.context [None req-57d6be0e-6032-4197-9320-4cfd578cc540 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6269e10f-dbf4-40a1-8167-ac8cb84bb97a(cell1) {{(pid=127677) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 17:48:21.951364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e314f8d8-0a88-43f9-8e4c-59faca2b0be4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:21.952124 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e314f8d8-0a88-43f9-8e4c-59faca2b0be4 None None] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:21.952574 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e314f8d8-0a88-43f9-8e4c-59faca2b0be4 None None] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:21.954232 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-57d6be0e-6032-4197-9320-4cfd578cc540 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:21.954623 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e314f8d8-0a88-43f9-8e4c-59faca2b0be4 None None] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:21.954802 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-57d6be0e-6032-4197-9320-4cfd578cc540 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:21.956300 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-57d6be0e-6032-4197-9320-4cfd578cc540 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:21.956671 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO dbcounter [None req-e314f8d8-0a88-43f9-8e4c-59faca2b0be4 None None] Registered counter for database nova_cell0 Aug 24 17:48:21.957061 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-57d6be0e-6032-4197-9320-4cfd578cc540 None None] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:21.957521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-57d6be0e-6032-4197-9320-4cfd578cc540 None None] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:21.959793 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-57d6be0e-6032-4197-9320-4cfd578cc540 None None] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:21.960917 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO dbcounter [None req-e314f8d8-0a88-43f9-8e4c-59faca2b0be4 None None] Registered counter for database nova_cell1 Aug 24 17:48:21.961891 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO dbcounter [None req-57d6be0e-6032-4197-9320-4cfd578cc540 None None] Registered counter for database nova_cell0 Aug 24 17:48:21.966297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO dbcounter [None req-57d6be0e-6032-4197-9320-4cfd578cc540 None None] Registered counter for database nova_cell1 Aug 24 17:48:21.968099 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_db.sqlalchemy.engines [None req-e314f8d8-0a88-43f9-8e4c-59faca2b0be4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:48:21.970585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_db.sqlalchemy.engines [None req-e314f8d8-0a88-43f9-8e4c-59faca2b0be4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:48:21.974988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_db.sqlalchemy.engines [None req-57d6be0e-6032-4197-9320-4cfd578cc540 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:48:21.976826 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_db.sqlalchemy.engines [None req-57d6be0e-6032-4197-9320-4cfd578cc540 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:48:21.981909 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writer thread running {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:48:21.982596 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writer thread running {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:48:21.985064 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writer thread running {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:48:21.987740 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writer thread running {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:48:22.133377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO dbcounter [None req-e314f8d8-0a88-43f9-8e4c-59faca2b0be4 None None] Registered counter for database nova_cell0 Aug 24 17:48:22.134651 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO dbcounter [None req-57d6be0e-6032-4197-9320-4cfd578cc540 None None] Registered counter for database nova_cell0 Aug 24 17:48:22.140444 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_db.sqlalchemy.engines [None req-e314f8d8-0a88-43f9-8e4c-59faca2b0be4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:48:22.142391 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_db.sqlalchemy.engines [None req-57d6be0e-6032-4197-9320-4cfd578cc540 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:48:22.145935 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writer thread running {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:48:22.147022 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writer thread running {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:48:22.472668 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: WARNING keystonemiddleware.auth_token [None req-e314f8d8-0a88-43f9-8e4c-59faca2b0be4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:48:22.476586 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: WARNING keystonemiddleware.auth_token [None req-57d6be0e-6032-4197-9320-4cfd578cc540 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:48:22.480256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: WARNING keystonemiddleware.auth_token [None req-e314f8d8-0a88-43f9-8e4c-59faca2b0be4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:48:22.484512 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: WARNING keystonemiddleware.auth_token [None req-57d6be0e-6032-4197-9320-4cfd578cc540 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:48:22.835606 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: WARNING keystonemiddleware.auth_token [None req-e314f8d8-0a88-43f9-8e4c-59faca2b0be4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:48:22.841944 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: WARNING keystonemiddleware.auth_token [None req-e314f8d8-0a88-43f9-8e4c-59faca2b0be4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:48:22.847413 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b7f7c989c0 pid: 127676 (default app) Aug 24 17:48:22.853246 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: WARNING keystonemiddleware.auth_token [None req-57d6be0e-6032-4197-9320-4cfd578cc540 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:48:22.859505 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: WARNING keystonemiddleware.auth_token [None req-57d6be0e-6032-4197-9320-4cfd578cc540 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:48:22.864888 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b7f7c989c0 pid: 127677 (default app) Aug 24 17:49:02.527398 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=3 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:02.528387 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=3 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:02.528957 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=3 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:02.536734 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=3 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:02.683716 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=3 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:02.687028 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=3 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:02.687028 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=3 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:02.698584 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=3 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:03.555249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-5253df18-aff9-4c0e-9bc9-436cb83d0e29 tempest-VolumesGetTestJSON-875288627 tempest-VolumesGetTestJSON-875288627-project] Action: 'create', calling method: .version_select at 0x7fce7d4309d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-507645250", "metadata": {"Type": "work"}}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:03.565897 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-3454481a-79d0-458c-84a3-eb76a60ca1e4 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Action: 'create', calling method: .version_select at 0x7fce7d4aa8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-692065003"}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:04.892558 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-5253df18-aff9-4c0e-9bc9-436cb83d0e29 tempest-VolumesGetTestJSON-875288627 tempest-VolumesGetTestJSON-875288627-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.218744 Aug 24 17:49:04.894937 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 1/1] 10.222.0.76 () {60 vars in 1156 bytes} [Wed Aug 24 17:49:02 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2223 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 17:49:04.900555 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-5af2b8a4-a447-443c-8ebc-6b796fc972b0 tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] Calling method '.version_select at 0x7fce7d306790>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:04.998619 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-5af2b8a4-a447-443c-8ebc-6b796fc972b0 tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/61c97f23-5ac8-43b1-8f29-a8858ce3c651" status: 200 len: 350 microversion: 2.1 time: 0.102294 Aug 24 17:49:05.006755 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 2/2] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 17:49:04 2022] GET /compute/v2.1/os-volumes/61c97f23-5ac8-43b1-8f29-a8858ce3c651 => generated 350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:05.006755 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-7f2e4305-ed99-4695-b500-f62af3ff3300 tempest-VolumesGetTestJSON-875288627 tempest-VolumesGetTestJSON-875288627-project] Calling method '.version_select at 0x7fce7d306b80>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:05.154290 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-7f2e4305-ed99-4695-b500-f62af3ff3300 tempest-VolumesGetTestJSON-875288627 tempest-VolumesGetTestJSON-875288627-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e" status: 200 len: 352 microversion: 2.1 time: 0.153569 Aug 24 17:49:05.155538 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 3/3] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 17:49:04 2022] GET /compute/v2.1/os-volumes/b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e => generated 352 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:05.235622 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-3454481a-79d0-458c-84a3-eb76a60ca1e4 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.722862 Aug 24 17:49:05.236883 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 1/4] 10.222.0.76 () {60 vars in 1155 bytes} [Wed Aug 24 17:49:02 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2726 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 17:49:05.252305 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1713d54a-05b3-4eab-84e3-806dc623905b tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Calling method '.version_select at 0x7fce7d31c280>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:05.630700 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1713d54a-05b3-4eab-84e3-806dc623905b tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/d0818b06-beb8-4cc4-9050-bb8870d68f64" status: 200 len: 344 microversion: 2.1 time: 0.134418 Aug 24 17:49:05.630700 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 4/5] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 17:49:05 2022] GET /compute/v2.1/os-volumes/d0818b06-beb8-4cc4-9050-bb8870d68f64 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:06.169757 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e4810701-f407-4e94-a457-ee80a7696ebf tempest-VolumesGetTestJSON-875288627 tempest-VolumesGetTestJSON-875288627-project] Calling method '.version_select at 0x7fce7d302700>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:06.304480 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e4810701-f407-4e94-a457-ee80a7696ebf tempest-VolumesGetTestJSON-875288627 tempest-VolumesGetTestJSON-875288627-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e" status: 200 len: 353 microversion: 2.1 time: 0.124218 Aug 24 17:49:06.304480 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 2/6] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 17:49:06 2022] GET /compute/v2.1/os-volumes/b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:06.316476 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3ba30764-006b-4633-8e9b-a735130027fa tempest-VolumesGetTestJSON-875288627 tempest-VolumesGetTestJSON-875288627-project] Calling method '.version_select at 0x7fce7d31c9d0>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:06.397347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-cb1b7f23-100c-477e-95e6-345adbe63306 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Calling method '.version_select at 0x7fce7d302e50>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:06.419367 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3ba30764-006b-4633-8e9b-a735130027fa tempest-VolumesGetTestJSON-875288627 tempest-VolumesGetTestJSON-875288627-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e" status: 200 len: 353 microversion: 2.1 time: 0.113822 Aug 24 17:49:06.420023 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 5/7] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 17:49:06 2022] GET /compute/v2.1/os-volumes/b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:06.443137 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e330dbef-f1f6-4c70-b1b0-1f9899ed15a6 tempest-VolumesGetTestJSON-875288627 tempest-VolumesGetTestJSON-875288627-project] Calling method '.version_select at 0x7fce7d306c10>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:06.477065 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-cb1b7f23-100c-477e-95e6-345adbe63306 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/d0818b06-beb8-4cc4-9050-bb8870d68f64" status: 200 len: 345 microversion: 2.1 time: 0.084027 Aug 24 17:49:06.478345 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 3/8] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 17:49:06 2022] GET /compute/v2.1/os-volumes/d0818b06-beb8-4cc4-9050-bb8870d68f64 => generated 345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:06.491919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-932ca443-5b5a-452c-b7db-ea76ee436a80 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Action: 'create', calling method: .version_select at 0x7fce7d31a4c0>, body: {"snapshot": {"volume_id": "d0818b06-beb8-4cc4-9050-bb8870d68f64", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1854830661"}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:06.680625 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-e330dbef-f1f6-4c70-b1b0-1f9899ed15a6 tempest-VolumesGetTestJSON-875288627 tempest-VolumesGetTestJSON-875288627-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e" status: 202 len: 0 microversion: 2.1 time: 0.243283 Aug 24 17:49:06.680625 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 6/9] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 24 17:49:06 2022] DELETE /compute/v2.1/os-volumes/b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:49:06.690319 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c7c93f7e-8dee-4462-a8be-f25fe90dec18 tempest-VolumesGetTestJSON-875288627 tempest-VolumesGetTestJSON-875288627-project] Calling method '.version_select at 0x7fce7d430a60>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:06.804943 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c7c93f7e-8dee-4462-a8be-f25fe90dec18 tempest-VolumesGetTestJSON-875288627 tempest-VolumesGetTestJSON-875288627-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e" status: 200 len: 352 microversion: 2.1 time: 0.120377 Aug 24 17:49:06.814018 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 7/10] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 17:49:06 2022] GET /compute/v2.1/os-volumes/b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:07.277467 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-cc4a8dd5-c111-47d0-8861-d192671f9da9 tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] Calling method '.version_select at 0x7fce7d31c8b0>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:07.537014 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-cc4a8dd5-c111-47d0-8861-d192671f9da9 tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/8ba600bc-2ab2-4f7a-9af7-be3b690dccc0" status: 200 len: 351 microversion: 2.1 time: 0.264549 Aug 24 17:49:07.537924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 8/11] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 17:49:07 2022] GET /compute/v2.1/os-volumes/8ba600bc-2ab2-4f7a-9af7-be3b690dccc0 => generated 351 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:07.558666 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-932ca443-5b5a-452c-b7db-ea76ee436a80 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] 10.222.0.76 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.071366 Aug 24 17:49:07.567195 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 4/12] 10.222.0.76 () {60 vars in 1162 bytes} [Wed Aug 24 17:49:06 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:07.571941 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-dce6bdf3-f015-4607-a39b-55722f41481b tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Calling method '.version_select at 0x7fce7d306670>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:07.622201 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-dce6bdf3-f015-4607-a39b-55722f41481b tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/be74075f-b099-4368-b5aa-360f6d29b5e6" status: 200 len: 287 microversion: 2.1 time: 0.053719 Aug 24 17:49:07.623036 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 9/13] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 17:49:07 2022] GET /compute/v2.1/os-snapshots/be74075f-b099-4368-b5aa-360f6d29b5e6 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:49:07.635504 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f6ba97d9-2fd6-4532-b8b7-ba2333d856bc tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Calling method '.version_select at 0x7fce7d31ae50>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:07.724299 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f6ba97d9-2fd6-4532-b8b7-ba2333d856bc tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.093489 Aug 24 17:49:07.724864 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 5/14] 10.222.0.76 () {58 vars in 1140 bytes} [Wed Aug 24 17:49:07 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:07.737423 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-b5821bb1-dbbc-4e98-af10-c439be313a5f tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Calling method '.version_select at 0x7fce7d306ee0>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:07.788148 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-b5821bb1-dbbc-4e98-af10-c439be313a5f tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/be74075f-b099-4368-b5aa-360f6d29b5e6" status: 200 len: 287 microversion: 2.1 time: 0.054708 Aug 24 17:49:07.788702 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 10/15] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 17:49:07 2022] GET /compute/v2.1/os-snapshots/be74075f-b099-4368-b5aa-360f6d29b5e6 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:07.824225 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-64b84317-810c-44ef-bee7-cac21101bd02 tempest-VolumesGetTestJSON-875288627 tempest-VolumesGetTestJSON-875288627-project] Calling method '.version_select at 0x7fce7d302820>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:07.883056 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-64b84317-810c-44ef-bee7-cac21101bd02 tempest-VolumesGetTestJSON-875288627 tempest-VolumesGetTestJSON-875288627-project] HTTP exception thrown: Volume b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e could not be found. Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-64b84317-810c-44ef-bee7-cac21101bd02 tempest-VolumesGetTestJSON-875288627 tempest-VolumesGetTestJSON-875288627-project] Request method failure captured: Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: GET /compute/v2.1/os-volumes/b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e HTTP/1.1 Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmSOLvTl0uca4TbY-b9AZrBftopQBXyHDKKV8nF_lG98HvK1mwN8Z2usIZrcBGez2n38vKgl3lmD6Mx-7uUvbA9nvKlKd00shiQfP3l0j3rdqGuPsDVq-2SH2CxUQeXUdN1aHckozhcLmlCmw33RHznJ_VvDDT8Sr2jdHYbr0Vms2mk Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: de73a596283345f2b6b87ce076767b78 Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-VolumesGetTestJSON-875288627 Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:49:07.900079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:49:07.901276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/de73a596283345f2b6b87ce076767b78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/de73a596283345f2b6b87ce076767b78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_de73a596283345f2b6b87ce076767b78", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/de73a596283345f2b6b87ce076767b78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:49:07.901276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-VolumesGetTestJSON-875288627 Aug 24 17:49:07.901276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: de73a596283345f2b6b87ce076767b78 Aug 24 17:49:07.901276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-VolumesGetTestJSON-875288627 Aug 24 17:49:07.901276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-VolumesGetTestJSON-875288627-project Aug 24 17:49:07.901276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:49:07.901276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:49:07.901276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: e8e82fcb6d7549b1b3a62e346e661945 Aug 24 17:49:07.901276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-VolumesGetTestJSON-875288627-project Aug 24 17:49:07.901276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: Aug 24 17:49:07.901276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Volume b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e could not be found. Aug 24 17:49:07.901276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': 'b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e'} Aug 24 17:49:07.901276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:49:07.901924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:07.901924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:49:07.901924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:49:07.901924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:49:07.901924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:49:07.901924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:49:07.901924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:49:07.901924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:49:07.901924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:49:07.901924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:49:07.901924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:49:07.901924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:49:07.901924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:49:07.901924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:49:07.901924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:49:07.901924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e could not be found. (HTTP 404) (Request-ID: req-31d800a4-b824-4c15-9bd4-5f9dbec0950e) Aug 24 17:49:07.901924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:07.901924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:07.901924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:07.902774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:07.902774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 17:49:07.902774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 17:49:07.902774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:49:07.902774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:49:07.902774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:49:07.902774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:49:07.902774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:49:07.902774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:49:07.902774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:49:07.902774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:49:07.902774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:49:07.902774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:49:07.902774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:49:07.902774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:49:07.902774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:49:07.902774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:49:07.902774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:49:07.902774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:49:07.903676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:49:07.903676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:49:07.903676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:49:07.903676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:49:07.903676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e could not be found. Aug 24 17:49:07.903676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:07.903676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:07.903676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:07.903676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:07.903676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:07.903676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:07.903676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:49:07.903676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:49:07.903676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:49:07.903676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:49:07.903676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:49:07.903676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:49:07.903676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 17:49:07.903676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:49:07.904526 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e could not be found. Aug 24 17:49:07.904526 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:07.904526 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:07.904526 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:07.904526 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:07.904526 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:07.904526 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:07.904526 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:49:07.904526 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:49:07.904526 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e could not be found. Aug 24 17:49:07.904526 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:07.908241 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-64b84317-810c-44ef-bee7-cac21101bd02 tempest-VolumesGetTestJSON-875288627 tempest-VolumesGetTestJSON-875288627-project] Returning 404 to user: Volume b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:49:07.909403 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-64b84317-810c-44ef-bee7-cac21101bd02 tempest-VolumesGetTestJSON-875288627 tempest-VolumesGetTestJSON-875288627-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e" status: 404 len: 109 microversion: 2.1 time: 0.089486 Aug 24 17:49:07.913163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 6/16] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 17:49:07 2022] GET /compute/v2.1/os-volumes/b4ae3b25-1f2c-4180-bfce-39cc8b65aa1e => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:49:08.801648 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-aecbecf9-e413-4c19-9861-57d0c3d1e007 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Calling method '.version_select at 0x7fce7d31c940>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:08.894532 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-aecbecf9-e413-4c19-9861-57d0c3d1e007 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/be74075f-b099-4368-b5aa-360f6d29b5e6" status: 200 len: 287 microversion: 2.1 time: 0.097244 Aug 24 17:49:08.895463 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 11/17] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 17:49:08 2022] GET /compute/v2.1/os-snapshots/be74075f-b099-4368-b5aa-360f6d29b5e6 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:09.913617 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-77572a14-33b9-4d6d-b77d-c030d45c9276 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Calling method '.version_select at 0x7fce7d302670>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:09.951143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-77572a14-33b9-4d6d-b77d-c030d45c9276 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/be74075f-b099-4368-b5aa-360f6d29b5e6" status: 200 len: 287 microversion: 2.1 time: 0.044744 Aug 24 17:49:09.952614 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 7/18] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 17:49:09 2022] GET /compute/v2.1/os-snapshots/be74075f-b099-4368-b5aa-360f6d29b5e6 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:10.971564 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ecbd19a6-7340-4cab-a3d3-a70a2598e3de tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Calling method '.version_select at 0x7fce7d31cee0>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:11.080602 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ecbd19a6-7340-4cab-a3d3-a70a2598e3de tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/be74075f-b099-4368-b5aa-360f6d29b5e6" status: 200 len: 287 microversion: 2.1 time: 0.117405 Aug 24 17:49:11.086744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 12/19] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 17:49:10 2022] GET /compute/v2.1/os-snapshots/be74075f-b099-4368-b5aa-360f6d29b5e6 => generated 287 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:11.840193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e1eeb180-e510-4780-b506-e283c3e16f83 tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] Calling method '.version_select at 0x7fce7d287670>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:11.949605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e1eeb180-e510-4780-b506-e283c3e16f83 tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/e57fce28-e028-4378-a604-ccc1ca0fb474" status: 200 len: 351 microversion: 2.1 time: 0.114090 Aug 24 17:49:11.950215 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 8/20] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 17:49:11 2022] GET /compute/v2.1/os-volumes/e57fce28-e028-4378-a604-ccc1ca0fb474 => generated 351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:11.963723 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-67a8ca12-2e7c-453f-a3de-1f5ab5c107ea tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] Calling method '.version_select at 0x7fce7d31c160>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:12.102564 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-45edaf40-b6c7-47d6-8da6-0652bbe77296 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Calling method '.version_select at 0x7fce7d4aa9d0>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:12.187899 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-45edaf40-b6c7-47d6-8da6-0652bbe77296 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/be74075f-b099-4368-b5aa-360f6d29b5e6" status: 200 len: 288 microversion: 2.1 time: 0.091801 Aug 24 17:49:12.189253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 9/21] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 17:49:12 2022] GET /compute/v2.1/os-snapshots/be74075f-b099-4368-b5aa-360f6d29b5e6 => generated 288 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:12.204878 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-fc9d7b93-7d0b-4793-a46a-ae6020af8e1d tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Calling method '.version_select at 0x7fce7d287280>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:12.268316 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-67a8ca12-2e7c-453f-a3de-1f5ab5c107ea tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.308532 Aug 24 17:49:12.285321 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 13/22] 10.222.0.76 () {58 vars in 1134 bytes} [Wed Aug 24 17:49:11 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:12.295326 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-eea59499-8f8d-453e-8ecb-7f346b8e1eed tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] Calling method '.version_select at 0x7fce7d306820>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:12.488994 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-eea59499-8f8d-453e-8ecb-7f346b8e1eed tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.201545 Aug 24 17:49:12.489748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 14/23] 10.222.0.76 () {58 vars in 1149 bytes} [Wed Aug 24 17:49:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:12.499204 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-fc9d7b93-7d0b-4793-a46a-ae6020af8e1d tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] 10.222.0.76 "DELETE /compute/v2.1/os-snapshots/be74075f-b099-4368-b5aa-360f6d29b5e6" status: 202 len: 0 microversion: 2.1 time: 0.291361 Aug 24 17:49:12.499204 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 10/24] 10.222.0.76 () {58 vars in 1254 bytes} [Wed Aug 24 17:49:12 2022] DELETE /compute/v2.1/os-snapshots/be74075f-b099-4368-b5aa-360f6d29b5e6 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:49:12.506813 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-7169d2b8-1973-4fe1-bae0-a004c66c85a1 tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] Calling method '.version_select at 0x7fce7d32dc10>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:12.521007 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-db3076a4-44b5-4fba-a827-7bb87da71e70 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Calling method '.version_select at 0x7fce7d287e50>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:12.607886 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-db3076a4-44b5-4fba-a827-7bb87da71e70 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/be74075f-b099-4368-b5aa-360f6d29b5e6" status: 200 len: 287 microversion: 2.1 time: 0.108883 Aug 24 17:49:12.608742 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 11/25] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 17:49:12 2022] GET /compute/v2.1/os-snapshots/be74075f-b099-4368-b5aa-360f6d29b5e6 => generated 287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:12.729366 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-7169d2b8-1973-4fe1-bae0-a004c66c85a1 tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.227843 Aug 24 17:49:12.744352 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-57079cd1-6b5d-46dc-97e9-c71fb26ea210 tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] Calling method '.version_select at 0x7fce7d2871f0>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:12.747890 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 15/26] 10.222.0.76 () {58 vars in 1134 bytes} [Wed Aug 24 17:49:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:12.870360 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-57079cd1-6b5d-46dc-97e9-c71fb26ea210 tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.130613 Aug 24 17:49:12.885221 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 12/27] 10.222.0.76 () {58 vars in 1167 bytes} [Wed Aug 24 17:49:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:12.887194 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-fb267c5d-053f-4c2a-b34e-2564335adc94 tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] Calling method '.version_select at 0x7fce7d32d040>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:13.066849 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-fb267c5d-053f-4c2a-b34e-2564335adc94 tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.184856 Aug 24 17:49:13.070065 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 16/28] 10.222.0.76 () {58 vars in 1170 bytes} [Wed Aug 24 17:49:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:13.088593 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b2636154-1c84-47b6-a6a4-7b85a6745a63 tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] Calling method '.version_select at 0x7fce7d2960d0>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:13.243777 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b2636154-1c84-47b6-a6a4-7b85a6745a63 tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.161021 Aug 24 17:49:13.259482 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 13/29] 10.222.0.76 () {58 vars in 1155 bytes} [Wed Aug 24 17:49:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:13.261021 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0cea6525-a6ab-4475-a3af-142d546559fc tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] Calling method '.version_select at 0x7fce7d31c3a0>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:13.399889 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0cea6525-a6ab-4475-a3af-142d546559fc tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.144343 Aug 24 17:49:13.401180 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 17/30] 10.222.0.76 () {58 vars in 1188 bytes} [Wed Aug 24 17:49:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:13.422457 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d2b48259-5e60-45f9-a55e-2b03dba5758c tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] Calling method '.version_select at 0x7fce7d298310>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:13.533575 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d2b48259-5e60-45f9-a55e-2b03dba5758c tempest-VolumesTestJSON-800171699 tempest-VolumesTestJSON-800171699-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.120892 Aug 24 17:49:13.548411 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 14/31] 10.222.0.76 () {58 vars in 1155 bytes} [Wed Aug 24 17:49:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:13.627453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9bd106be-cd08-49d0-9e2b-9150138e1f98 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Calling method '.version_select at 0x7fce7d2b2af0>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:13.693478 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-9bd106be-cd08-49d0-9e2b-9150138e1f98 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] HTTP exception thrown: Snapshot be74075f-b099-4368-b5aa-360f6d29b5e6 could not be found. Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9bd106be-cd08-49d0-9e2b-9150138e1f98 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Request method failure captured: Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/os-snapshots/be74075f-b099-4368-b5aa-360f6d29b5e6 HTTP/1.1 Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmSO1ZZ2Dlik9NqDpjtCxFnD6sZv3IYUEOOIyqr_Q5AAAFg3WE9S7OyDgqAsJhBYQOPlH4EHyUgc9Dg7QEgzHnDU5IP2G-DBNCpbrxRSuAMKXmtTmhcAr9Yud2ZRPBCXo1sEP5_2NNCTxazqocF9vSsTyFfkOZaB6VFDXjdLlXWLA-s Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 49fb7ae63dac46a3883ef566a3763870 Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-419783941 Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:49:13.698880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:49:13.700026 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/49fb7ae63dac46a3883ef566a3763870"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/49fb7ae63dac46a3883ef566a3763870"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_49fb7ae63dac46a3883ef566a3763870", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/49fb7ae63dac46a3883ef566a3763870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:49:13.700026 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-VolumesSnapshotsTestJSON-419783941 Aug 24 17:49:13.700026 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 49fb7ae63dac46a3883ef566a3763870 Aug 24 17:49:13.700026 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-419783941 Aug 24 17:49:13.700026 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-VolumesSnapshotsTestJSON-419783941-project Aug 24 17:49:13.700026 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:49:13.700026 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:49:13.700026 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: 181725023fc14d8e9d077d6012eb2e22 Aug 24 17:49:13.700026 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-VolumesSnapshotsTestJSON-419783941-project Aug 24 17:49:13.700026 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: Aug 24 17:49:13.700026 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Snapshot be74075f-b099-4368-b5aa-360f6d29b5e6 could not be found. Aug 24 17:49:13.700026 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': 'be74075f-b099-4368-b5aa-360f6d29b5e6'} Aug 24 17:49:13.700026 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:49:13.700696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:13.700696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 17:49:13.700696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 17:49:13.700696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 17:49:13.700696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 17:49:13.700696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 17:49:13.700696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 17:49:13.700696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:49:13.700696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:49:13.700696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:49:13.700696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:49:13.700696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:49:13.700696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:49:13.700696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:49:13.700696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:49:13.700696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot be74075f-b099-4368-b5aa-360f6d29b5e6 could not be found. (HTTP 404) (Request-ID: req-4fecd09d-d7a4-4f13-ae03-ed3f513dd530) Aug 24 17:49:13.700696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:49:13.700696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:13.701507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:49:13.701507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:13.701507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 17:49:13.701507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 17:49:13.701507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:49:13.701507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:49:13.701507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 17:49:13.701507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 17:49:13.701507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:49:13.701507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:49:13.701507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 17:49:13.701507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 17:49:13.701507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 17:49:13.701507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 17:49:13.701507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 17:49:13.701507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 17:49:13.701507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:49:13.701507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:49:13.701507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot be74075f-b099-4368-b5aa-360f6d29b5e6 could not be found. Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 17:49:13.712896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:49:13.714764 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot be74075f-b099-4368-b5aa-360f6d29b5e6 could not be found. Aug 24 17:49:13.714764 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:49:13.714764 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:13.714764 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:49:13.714764 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:13.714764 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:13.714764 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:13.714764 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:49:13.714764 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:49:13.714764 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot be74075f-b099-4368-b5aa-360f6d29b5e6 could not be found. Aug 24 17:49:13.714764 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:49:13.714764 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9bd106be-cd08-49d0-9e2b-9150138e1f98 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Returning 404 to user: Snapshot be74075f-b099-4368-b5aa-360f6d29b5e6 could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:49:13.714764 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9bd106be-cd08-49d0-9e2b-9150138e1f98 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/be74075f-b099-4368-b5aa-360f6d29b5e6" status: 404 len: 111 microversion: 2.1 time: 0.083364 Aug 24 17:49:13.720071 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 18/32] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 17:49:13 2022] GET /compute/v2.1/os-snapshots/be74075f-b099-4368-b5aa-360f6d29b5e6 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:49:13.732305 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e8dddd14-bc3b-4346-acc4-76f190dac421 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Calling method '.version_select at 0x7fce7d4aa9d0>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:13.974312 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e8dddd14-bc3b-4346-acc4-76f190dac421 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/d0818b06-beb8-4cc4-9050-bb8870d68f64" status: 202 len: 0 microversion: 2.1 time: 0.249491 Aug 24 17:49:13.975602 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 15/33] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 24 17:49:13 2022] DELETE /compute/v2.1/os-volumes/d0818b06-beb8-4cc4-9050-bb8870d68f64 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:49:13.992377 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-29e02278-4d90-4c7b-b441-c334ef864611 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Calling method '.version_select at 0x7fce7d32d0d0>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:14.178810 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-29e02278-4d90-4c7b-b441-c334ef864611 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/d0818b06-beb8-4cc4-9050-bb8870d68f64" status: 200 len: 344 microversion: 2.1 time: 0.198539 Aug 24 17:49:14.179892 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 19/34] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 17:49:13 2022] GET /compute/v2.1/os-volumes/d0818b06-beb8-4cc4-9050-bb8870d68f64 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:15.195952 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-3504dac1-b8d5-42e0-9812-e80c8acfb326 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Calling method '.version_select at 0x7fce7d287dc0>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:15.256320 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-3504dac1-b8d5-42e0-9812-e80c8acfb326 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] HTTP exception thrown: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-3504dac1-b8d5-42e0-9812-e80c8acfb326 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Request method failure captured: Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: GET /compute/v2.1/os-volumes/d0818b06-beb8-4cc4-9050-bb8870d68f64 HTTP/1.1 Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmSO1ZZ2Dlik9NqDpjtCxFnD6sZv3IYUEOOIyqr_Q5AAAFg3WE9S7OyDgqAsJhBYQOPlH4EHyUgc9Dg7QEgzHnDU5IP2G-DBNCpbrxRSuAMKXmtTmhcAr9Yud2ZRPBCXo1sEP5_2NNCTxazqocF9vSsTyFfkOZaB6VFDXjdLlXWLA-s Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 49fb7ae63dac46a3883ef566a3763870 Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-419783941 Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:49:15.258460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:49:15.272426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/49fb7ae63dac46a3883ef566a3763870"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/49fb7ae63dac46a3883ef566a3763870"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_49fb7ae63dac46a3883ef566a3763870", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/49fb7ae63dac46a3883ef566a3763870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:49:15.272426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-VolumesSnapshotsTestJSON-419783941 Aug 24 17:49:15.272426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 49fb7ae63dac46a3883ef566a3763870 Aug 24 17:49:15.272426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-419783941 Aug 24 17:49:15.272426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-VolumesSnapshotsTestJSON-419783941-project Aug 24 17:49:15.272426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:49:15.272426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:49:15.272426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 181725023fc14d8e9d077d6012eb2e22 Aug 24 17:49:15.272426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-VolumesSnapshotsTestJSON-419783941-project Aug 24 17:49:15.272426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: Aug 24 17:49:15.272426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. Aug 24 17:49:15.272426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': 'd0818b06-beb8-4cc4-9050-bb8870d68f64'} Aug 24 17:49:15.272426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:49:15.273931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:15.273931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:49:15.273931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:49:15.273931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:49:15.273931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:49:15.273931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:49:15.273931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:49:15.273931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:49:15.273931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:49:15.273931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:49:15.273931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:49:15.273931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:49:15.273931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:49:15.273931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:49:15.273931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:49:15.273931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. (HTTP 404) (Request-ID: req-a4df5d04-b8cf-4a64-b335-99f12d5794e1) Aug 24 17:49:15.273931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.273931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:15.273931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.275085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:15.275085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 17:49:15.275085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 17:49:15.275085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:49:15.275085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:49:15.275085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:49:15.275085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:49:15.275085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:49:15.275085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:49:15.275085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:49:15.275085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:49:15.275085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:49:15.275085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:49:15.275085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:49:15.275085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:49:15.275085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:49:15.275085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:49:15.275085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:49:15.275085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:49:15.276919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:49:15.276919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:49:15.276919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:49:15.276919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:49:15.276919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. Aug 24 17:49:15.276919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.276919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:15.276919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.276919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:15.276919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:15.276919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:15.276919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:49:15.276919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:49:15.276919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:49:15.276919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:49:15.276919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:49:15.276919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:49:15.276919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 17:49:15.276919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:49:15.279406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. Aug 24 17:49:15.279406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.279406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:15.279406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.279406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:15.279406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:15.279406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:15.279406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:49:15.279406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:49:15.279406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. Aug 24 17:49:15.279406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.279406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-3504dac1-b8d5-42e0-9812-e80c8acfb326 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Returning 404 to user: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:49:15.279406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-3504dac1-b8d5-42e0-9812-e80c8acfb326 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/d0818b06-beb8-4cc4-9050-bb8870d68f64" status: 404 len: 109 microversion: 2.1 time: 0.071420 Aug 24 17:49:15.279406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 16/35] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 17:49:15 2022] GET /compute/v2.1/os-volumes/d0818b06-beb8-4cc4-9050-bb8870d68f64 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:49:15.282531 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4b8b00a3-216e-4a95-b8da-23e0db0f2480 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Calling method '.version_select at 0x7fce7d2b2c10>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:15.406780 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-4b8b00a3-216e-4a95-b8da-23e0db0f2480 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] HTTP exception thrown: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4b8b00a3-216e-4a95-b8da-23e0db0f2480 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Request method failure captured: Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: DELETE /compute/v2.1/os-volumes/d0818b06-beb8-4cc4-9050-bb8870d68f64 HTTP/1.1 Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmSO1ZZ2Dlik9NqDpjtCxFnD6sZv3IYUEOOIyqr_Q5AAAFg3WE9S7OyDgqAsJhBYQOPlH4EHyUgc9Dg7QEgzHnDU5IP2G-DBNCpbrxRSuAMKXmtTmhcAr9Yud2ZRPBCXo1sEP5_2NNCTxazqocF9vSsTyFfkOZaB6VFDXjdLlXWLA-s Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 49fb7ae63dac46a3883ef566a3763870 Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-419783941 Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:49:15.411356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:49:15.412384 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/49fb7ae63dac46a3883ef566a3763870"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/49fb7ae63dac46a3883ef566a3763870"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_49fb7ae63dac46a3883ef566a3763870", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/49fb7ae63dac46a3883ef566a3763870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:49:15.412384 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-VolumesSnapshotsTestJSON-419783941 Aug 24 17:49:15.412384 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 49fb7ae63dac46a3883ef566a3763870 Aug 24 17:49:15.412384 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-419783941 Aug 24 17:49:15.412384 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-VolumesSnapshotsTestJSON-419783941-project Aug 24 17:49:15.412384 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:49:15.412384 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:49:15.412384 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: 181725023fc14d8e9d077d6012eb2e22 Aug 24 17:49:15.412384 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-VolumesSnapshotsTestJSON-419783941-project Aug 24 17:49:15.412384 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: Aug 24 17:49:15.412384 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. Aug 24 17:49:15.412384 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': 'd0818b06-beb8-4cc4-9050-bb8870d68f64'} Aug 24 17:49:15.412384 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:49:15.413007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:15.413007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:49:15.413007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:49:15.413007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:49:15.413007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:49:15.413007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:49:15.413007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:49:15.413007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:49:15.413007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:49:15.413007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:49:15.413007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:49:15.413007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:49:15.413007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:49:15.413007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:49:15.413007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:49:15.413007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. (HTTP 404) (Request-ID: req-f80cfa2c-8fa0-44c1-9bfa-b69ed4787704) Aug 24 17:49:15.413007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.413007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:15.413007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.413919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:15.413919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 17:49:15.413919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 17:49:15.413919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:49:15.413919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:49:15.413919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:49:15.413919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:49:15.413919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:49:15.413919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:49:15.413919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:49:15.413919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:49:15.413919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:49:15.413919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:49:15.413919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:49:15.413919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:49:15.413919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:49:15.413919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:49:15.413919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:49:15.413919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:49:15.414824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:49:15.414824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:49:15.414824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:49:15.414824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:49:15.414824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. Aug 24 17:49:15.414824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.414824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:15.414824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.414824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:15.414824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:15.414824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:15.414824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:49:15.414824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:49:15.414824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:49:15.414824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:49:15.414824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:49:15.414824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:49:15.414824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 17:49:15.414824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:49:15.415927 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. Aug 24 17:49:15.415927 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.415927 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:15.415927 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.415927 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:15.415927 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:15.415927 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:15.415927 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:49:15.415927 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:49:15.415927 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. Aug 24 17:49:15.415927 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.418112 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4b8b00a3-216e-4a95-b8da-23e0db0f2480 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Returning 404 to user: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:49:15.420441 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-4b8b00a3-216e-4a95-b8da-23e0db0f2480 tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/d0818b06-beb8-4cc4-9050-bb8870d68f64" status: 404 len: 109 microversion: 2.1 time: 0.148607 Aug 24 17:49:15.422983 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 20/36] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 24 17:49:15 2022] DELETE /compute/v2.1/os-volumes/d0818b06-beb8-4cc4-9050-bb8870d68f64 => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:49:15.433802 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-97902a3e-5838-4ee4-9ddd-00ea6ab9109c tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Calling method '.version_select at 0x7fce7d31af70>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:15.509607 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-97902a3e-5838-4ee4-9ddd-00ea6ab9109c tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] HTTP exception thrown: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-97902a3e-5838-4ee4-9ddd-00ea6ab9109c tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Request method failure captured: Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: GET /compute/v2.1/os-volumes/d0818b06-beb8-4cc4-9050-bb8870d68f64 HTTP/1.1 Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmSO1ZZ2Dlik9NqDpjtCxFnD6sZv3IYUEOOIyqr_Q5AAAFg3WE9S7OyDgqAsJhBYQOPlH4EHyUgc9Dg7QEgzHnDU5IP2G-DBNCpbrxRSuAMKXmtTmhcAr9Yud2ZRPBCXo1sEP5_2NNCTxazqocF9vSsTyFfkOZaB6VFDXjdLlXWLA-s Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 49fb7ae63dac46a3883ef566a3763870 Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-419783941 Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:49:15.513717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:49:15.514813 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/49fb7ae63dac46a3883ef566a3763870"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/49fb7ae63dac46a3883ef566a3763870"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_49fb7ae63dac46a3883ef566a3763870", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/49fb7ae63dac46a3883ef566a3763870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:49:15.514813 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-VolumesSnapshotsTestJSON-419783941 Aug 24 17:49:15.514813 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 49fb7ae63dac46a3883ef566a3763870 Aug 24 17:49:15.514813 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-419783941 Aug 24 17:49:15.514813 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-VolumesSnapshotsTestJSON-419783941-project Aug 24 17:49:15.514813 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:49:15.514813 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:49:15.514813 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 181725023fc14d8e9d077d6012eb2e22 Aug 24 17:49:15.514813 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-VolumesSnapshotsTestJSON-419783941-project Aug 24 17:49:15.514813 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: Aug 24 17:49:15.514813 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. Aug 24 17:49:15.514813 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': 'd0818b06-beb8-4cc4-9050-bb8870d68f64'} Aug 24 17:49:15.514813 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:49:15.515429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:15.515429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:49:15.515429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:49:15.515429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:49:15.515429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:49:15.515429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:49:15.515429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:49:15.515429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:49:15.515429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:49:15.515429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:49:15.515429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:49:15.515429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:49:15.515429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:49:15.515429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:49:15.515429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:49:15.515429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. (HTTP 404) (Request-ID: req-6bacd62d-416b-4d8d-a87b-ef3c9845f67c) Aug 24 17:49:15.515429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.515429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:15.515429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.516811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:15.516811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 17:49:15.516811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 17:49:15.516811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:49:15.516811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:49:15.516811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:49:15.516811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:49:15.516811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:49:15.516811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:49:15.516811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:49:15.516811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:49:15.516811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:49:15.516811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:49:15.516811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:49:15.516811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:49:15.516811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:49:15.516811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:49:15.516811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:49:15.516811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:49:15.517673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:49:15.517673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:49:15.517673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:49:15.517673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:49:15.517673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. Aug 24 17:49:15.517673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.517673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:15.517673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.517673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:15.517673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:15.517673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:15.517673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:49:15.517673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:49:15.517673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:49:15.517673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:49:15.517673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:49:15.517673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:49:15.517673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 17:49:15.517673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:49:15.520028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. Aug 24 17:49:15.520028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.520028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:15.520028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.520028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:15.520028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:15.520028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:15.520028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:49:15.520028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:49:15.520028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. Aug 24 17:49:15.520028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:49:15.520028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-97902a3e-5838-4ee4-9ddd-00ea6ab9109c tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] Returning 404 to user: Volume d0818b06-beb8-4cc4-9050-bb8870d68f64 could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:49:15.520028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-97902a3e-5838-4ee4-9ddd-00ea6ab9109c tempest-VolumesSnapshotsTestJSON-419783941 tempest-VolumesSnapshotsTestJSON-419783941-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/d0818b06-beb8-4cc4-9050-bb8870d68f64" status: 404 len: 109 microversion: 2.1 time: 0.086443 Aug 24 17:49:15.520028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 17/37] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 17:49:15 2022] GET /compute/v2.1/os-volumes/d0818b06-beb8-4cc4-9050-bb8870d68f64 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:49:16.291086 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9b7112be-0a91-4360-8f1f-fbee462d028e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2039498947", "imageRef": "2d76d745-abc6-4a7b-b8d7-46566b66934b", "flavorRef": "452", "networks": [{"uuid": "8f096497-94f9-455d-8134-3642b4bcb49d"}]}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:16.567467 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.network.neutron [None req-9b7112be-0a91-4360-8f1f-fbee462d028e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] validate_networks() for [('8f096497-94f9-455d-8134-3642b4bcb49d', None, None, None, None, None)] {{(pid=127677) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:49:16.873330 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-c0a56381-775c-4dfd-b116-2171eb7600d9 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Action: 'create', calling method: .version_select at 0x7fce7d296820>, body: {"keypair": {"name": "tempest-keypair-760398761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGKKNqJW6fhwFrJsIBPdapwRMGCUW9TkLV2G2vN/2oIr1yRQcz7bO90wZym5wGN5wFg9VRniMOjt1Agzwr1gX7xfbyf+bDOQy2JRjgPPXqGHB3pABmUHTiJQ0l3fZxMug=="}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:16.995633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-c0a56381-775c-4dfd-b116-2171eb7600d9 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Getting quotas for project 0a4d7fadea104c569ca29ff9be48089a. Resources: {'key_pairs'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:49:17.003967 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-c0a56381-775c-4dfd-b116-2171eb7600d9 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Getting quotas for user 251bc85f89774142a97acd77895b14e9 and project 0a4d7fadea104c569ca29ff9be48089a. Resources: {'key_pairs'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:49:17.229022 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-c0a56381-775c-4dfd-b116-2171eb7600d9 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.324174 Aug 24 17:49:17.232287 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 18/38] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 17:49:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:20.583085 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-9b7112be-0a91-4360-8f1f-fbee462d028e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Flavor limits 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:49:20.584408 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-9b7112be-0a91-4360-8f1f-fbee462d028e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Image limits 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:49:20.585050 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-9b7112be-0a91-4360-8f1f-fbee462d028e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Flavor pref 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:49:20.586527 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-9b7112be-0a91-4360-8f1f-fbee462d028e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Image pref 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:49:20.587329 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-9b7112be-0a91-4360-8f1f-fbee462d028e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:49:20.631787 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9b7112be-0a91-4360-8f1f-fbee462d028e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:20.648937 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9b7112be-0a91-4360-8f1f-fbee462d028e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:20.653153 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9b7112be-0a91-4360-8f1f-fbee462d028e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:20.654525 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9b7112be-0a91-4360-8f1f-fbee462d028e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:20.655269 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9b7112be-0a91-4360-8f1f-fbee462d028e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:20.655978 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9b7112be-0a91-4360-8f1f-fbee462d028e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:20.711142 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-9b7112be-0a91-4360-8f1f-fbee462d028e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Getting quotas for project b8a384a5f96e488fb3c4abd75fd876fb. Resources: {'instances', 'ram', 'cores'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:49:20.726612 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-9b7112be-0a91-4360-8f1f-fbee462d028e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Getting quotas for user f5fcd46b400942a99dafdba6327ba49e and project b8a384a5f96e488fb3c4abd75fd876fb. Resources: {'instances', 'ram', 'cores'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:49:20.754367 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9b7112be-0a91-4360-8f1f-fbee462d028e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Going to run 1 instances... {{(pid=127677) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:49:20.758795 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9b7112be-0a91-4360-8f1f-fbee462d028e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d76d745-abc6-4a7b-b8d7-46566b66934b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:49:20.993681 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9b7112be-0a91-4360-8f1f-fbee462d028e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.353045 Aug 24 17:49:20.994627 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 21/39] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 17:49:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 5355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:49:21.012216 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5e95978d-289a-4a81-b791-06812aeedaa2 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:21.018649 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5e95978d-289a-4a81-b791-06812aeedaa2 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:21.343643 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5e95978d-289a-4a81-b791-06812aeedaa2 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:21.369527 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5e95978d-289a-4a81-b791-06812aeedaa2 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1215 microversion: 2.1 time: 0.359285 Aug 24 17:49:21.369527 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 19/40] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:21 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1215 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:22.395048 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-4a0a7765-0b93-4754-bbc2-48ab49b76ce9 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:22.395727 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4a0a7765-0b93-4754-bbc2-48ab49b76ce9 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:22.543020 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-4a0a7765-0b93-4754-bbc2-48ab49b76ce9 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:22.565062 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-4a0a7765-0b93-4754-bbc2-48ab49b76ce9 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1215 microversion: 2.1 time: 0.173511 Aug 24 17:49:22.567335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 20/41] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:22 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1215 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:22.807209 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-957db3cd-b936-48d9-9414-14a39ce1e0b6 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Action: 'create', calling method: .version_select at 0x7fce7c9944c0>, body: {"keypair": {"name": "tempest-keypair-1380642430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTT1bZ/uf04akqoIjXJgBgR9GV9stqfllqVM866X4IvXQlwtnvY3EfL/99gv/q34jK8g5BSYhltcpuntTZ2OtWMk5GnXLEPXwDBG4f1XhAcZmcYbayUrk/MDF2FxuK5vg=="}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:22.854046 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-957db3cd-b936-48d9-9414-14a39ce1e0b6 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Getting quotas for project 40256802535d4aedb2541246a687ec76. Resources: {'key_pairs'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:49:22.866800 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-957db3cd-b936-48d9-9414-14a39ce1e0b6 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Getting quotas for user 2b6b0d0cbdb54a46a7e9d6936c47cc4c and project 40256802535d4aedb2541246a687ec76. Resources: {'key_pairs'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:49:23.151605 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-957db3cd-b936-48d9-9414-14a39ce1e0b6 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.550340 Aug 24 17:49:23.152227 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 22/42] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 17:49:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:23.593117 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-067489a6-d546-44e9-a998-afbd92328e3d tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:23.593117 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-067489a6-d546-44e9-a998-afbd92328e3d tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:23.841239 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-067489a6-d546-44e9-a998-afbd92328e3d tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:23.851314 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-067489a6-d546-44e9-a998-afbd92328e3d tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1215 microversion: 2.1 time: 0.267398 Aug 24 17:49:23.856987 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 21/43] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:23 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1215 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:24.882074 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c9f514fe-b594-4226-a72d-c5ffb6e12a79 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:24.882886 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c9f514fe-b594-4226-a72d-c5ffb6e12a79 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:24.945210 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9f514fe-b594-4226-a72d-c5ffb6e12a79 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:24.945904 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9f514fe-b594-4226-a72d-c5ffb6e12a79 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:24.946482 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9f514fe-b594-4226-a72d-c5ffb6e12a79 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:24.949008 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9f514fe-b594-4226-a72d-c5ffb6e12a79 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:24.949621 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9f514fe-b594-4226-a72d-c5ffb6e12a79 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:24.952099 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9f514fe-b594-4226-a72d-c5ffb6e12a79 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:25.244240 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c9f514fe-b594-4226-a72d-c5ffb6e12a79 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:25.270428 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c9f514fe-b594-4226-a72d-c5ffb6e12a79 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1219 microversion: 2.1 time: 0.393399 Aug 24 17:49:25.271705 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 23/44] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:24 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1219 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:25.870746 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-6d391a0d-530d-4fea-a05f-46240b0949de tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-374861633", "imageRef": "2d76d745-abc6-4a7b-b8d7-46566b66934b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60b1f9c5-31f3-434f-b4cc-45bc1ad7c5b8"}], "security_groups": [{"name": "tempest-securitygroup--198560382"}], "key_name": "tempest-keypair-760398761", "user_data": "}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:26.151465 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ad4bdd0d-4b18-44d7-ba5f-2fc68fe12e61 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Action: 'create', calling method: .version_select at 0x7fce7c9c2b80>, body: {"keypair": {"name": "tempest-keypair-197525532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCFLJNLS2Dw1Od94mmTR3lGD+8czZLTzb1VNg1puTTu/lALEzJa8evq/rH85uwcE9fCWbETpWaAj8jCaPMgncNIjB0Lu+3ARa9sKzXD4jbxQs2f4izRMgr81BJf1jePAg=="}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:26.215830 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-ad4bdd0d-4b18-44d7-ba5f-2fc68fe12e61 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Getting quotas for project 9398272c7a3f4a50a38df4b5dec9ac90. Resources: {'key_pairs'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:49:26.224171 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-ad4bdd0d-4b18-44d7-ba5f-2fc68fe12e61 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Getting quotas for user 612dfebb8ebc401bb81d3d3333577566 and project 9398272c7a3f4a50a38df4b5dec9ac90. Resources: {'key_pairs'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:49:26.323154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.network.neutron [None req-6d391a0d-530d-4fea-a05f-46240b0949de tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] validate_networks() for [('60b1f9c5-31f3-434f-b4cc-45bc1ad7c5b8', None, None, None, None, None)] {{(pid=127677) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:49:26.340128 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-ad4bdd0d-4b18-44d7-ba5f-2fc68fe12e61 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.202322 Aug 24 17:49:26.342316 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 22/45] 10.222.0.76 () {62 vars in 1200 bytes} [Wed Aug 24 17:49:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1206 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 17:49:26.349614 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-57009071-9989-4429-900e-7f1b1243aed7 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:26.351717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-57009071-9989-4429-900e-7f1b1243aed7 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:26.370507 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57009071-9989-4429-900e-7f1b1243aed7 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:26.371051 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57009071-9989-4429-900e-7f1b1243aed7 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:26.372399 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57009071-9989-4429-900e-7f1b1243aed7 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:26.378903 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57009071-9989-4429-900e-7f1b1243aed7 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:26.378903 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57009071-9989-4429-900e-7f1b1243aed7 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:26.378903 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57009071-9989-4429-900e-7f1b1243aed7 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:26.741174 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-57009071-9989-4429-900e-7f1b1243aed7 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:26.765639 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-57009071-9989-4429-900e-7f1b1243aed7 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1275 microversion: 2.1 time: 0.421463 Aug 24 17:49:26.783645 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 23/46] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:26 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1275 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:27.119496 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-6d391a0d-530d-4fea-a05f-46240b0949de tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Flavor limits 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:49:27.120071 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-6d391a0d-530d-4fea-a05f-46240b0949de tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Image limits 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:49:27.120751 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-6d391a0d-530d-4fea-a05f-46240b0949de tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Flavor pref 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:49:27.125123 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-6d391a0d-530d-4fea-a05f-46240b0949de tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Image pref 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:49:27.125123 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-6d391a0d-530d-4fea-a05f-46240b0949de tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:49:27.159778 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6d391a0d-530d-4fea-a05f-46240b0949de tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:27.162222 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6d391a0d-530d-4fea-a05f-46240b0949de tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:27.163578 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6d391a0d-530d-4fea-a05f-46240b0949de tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:27.165647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6d391a0d-530d-4fea-a05f-46240b0949de tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:27.167938 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6d391a0d-530d-4fea-a05f-46240b0949de tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:27.168740 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6d391a0d-530d-4fea-a05f-46240b0949de tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:27.200188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-6d391a0d-530d-4fea-a05f-46240b0949de tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Getting quotas for project 0a4d7fadea104c569ca29ff9be48089a. Resources: {'instances', 'ram', 'cores'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:49:27.207465 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-6d391a0d-530d-4fea-a05f-46240b0949de tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Getting quotas for user 251bc85f89774142a97acd77895b14e9 and project 0a4d7fadea104c569ca29ff9be48089a. Resources: {'instances', 'ram', 'cores'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:49:27.228372 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-6d391a0d-530d-4fea-a05f-46240b0949de tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Going to run 1 instances... {{(pid=127677) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:49:27.231393 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-6d391a0d-530d-4fea-a05f-46240b0949de tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d76d745-abc6-4a7b-b8d7-46566b66934b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:49:27.500065 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-6d391a0d-530d-4fea-a05f-46240b0949de tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.634360 Aug 24 17:49:27.505549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 24/47] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 17:49:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:49:27.526433 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-81b2cf9c-94e9-4ae5-8e3f-9ae83983edaa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:27.527822 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-81b2cf9c-94e9-4ae5-8e3f-9ae83983edaa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:27.667893 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-81b2cf9c-94e9-4ae5-8e3f-9ae83983edaa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:27.688608 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-81b2cf9c-94e9-4ae5-8e3f-9ae83983edaa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1240 microversion: 2.1 time: 0.166087 Aug 24 17:49:27.703618 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 24/48] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:27 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1240 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:27.802821 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-50012bf0-463f-4485-ac7d-b73a2a32c543 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:27.802821 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-50012bf0-463f-4485-ac7d-b73a2a32c543 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:27.828336 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-50012bf0-463f-4485-ac7d-b73a2a32c543 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:27.834424 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-50012bf0-463f-4485-ac7d-b73a2a32c543 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:27.837144 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-50012bf0-463f-4485-ac7d-b73a2a32c543 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:27.847438 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-50012bf0-463f-4485-ac7d-b73a2a32c543 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:27.847908 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-50012bf0-463f-4485-ac7d-b73a2a32c543 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:27.848478 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-50012bf0-463f-4485-ac7d-b73a2a32c543 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:27.991437 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-50012bf0-463f-4485-ac7d-b73a2a32c543 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:28.007787 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-50012bf0-463f-4485-ac7d-b73a2a32c543 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1273 microversion: 2.1 time: 0.216685 Aug 24 17:49:28.017979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 25/49] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:27 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1273 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:28.278834 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-465b21ac-c66f-43fe-8c60-c71a06bb15d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-325343313", "imageRef": "2d76d745-abc6-4a7b-b8d7-46566b66934b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "389a41b1-7bca-4893-9c00-f7c2a36844c1"}], "security_groups": [{"name": "tempest-securitygroup--63845578"}], "key_name": "tempest-keypair-1380642430", "user_data": "}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:28.665952 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.network.neutron [None req-465b21ac-c66f-43fe-8c60-c71a06bb15d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] validate_networks() for [('389a41b1-7bca-4893-9c00-f7c2a36844c1', None, None, None, None, None)] {{(pid=127676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:49:28.711886 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-19789a0d-4a3e-4406-a62d-5069e5b09d9d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:28.712527 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-19789a0d-4a3e-4406-a62d-5069e5b09d9d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:28.937784 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-19789a0d-4a3e-4406-a62d-5069e5b09d9d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:28.962347 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-19789a0d-4a3e-4406-a62d-5069e5b09d9d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1240 microversion: 2.1 time: 0.254584 Aug 24 17:49:28.965247 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 26/50] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:28 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1240 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:29.033121 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d629ed4d-cab5-4ffa-9da3-8b435320ca5a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:29.034663 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d629ed4d-cab5-4ffa-9da3-8b435320ca5a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:29.050874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d629ed4d-cab5-4ffa-9da3-8b435320ca5a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:29.051395 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d629ed4d-cab5-4ffa-9da3-8b435320ca5a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:29.052437 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d629ed4d-cab5-4ffa-9da3-8b435320ca5a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:29.054253 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d629ed4d-cab5-4ffa-9da3-8b435320ca5a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:29.055865 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d629ed4d-cab5-4ffa-9da3-8b435320ca5a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:29.057259 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d629ed4d-cab5-4ffa-9da3-8b435320ca5a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:29.234639 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d629ed4d-cab5-4ffa-9da3-8b435320ca5a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:29.244172 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d629ed4d-cab5-4ffa-9da3-8b435320ca5a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1273 microversion: 2.1 time: 0.216887 Aug 24 17:49:29.244995 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 27/51] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:29 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1273 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:29.993053 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-8d56e626-8072-46b4-9053-d5462aa50948 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:29.994458 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-8d56e626-8072-46b4-9053-d5462aa50948 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:30.142174 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-8d56e626-8072-46b4-9053-d5462aa50948 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:30.185471 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-8d56e626-8072-46b4-9053-d5462aa50948 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1240 microversion: 2.1 time: 0.190183 Aug 24 17:49:30.189630 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 28/52] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:29 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1240 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:30.269177 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a686f341-692b-4b46-92d5-11b6332e0f14 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:30.270479 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a686f341-692b-4b46-92d5-11b6332e0f14 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:30.303993 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a686f341-692b-4b46-92d5-11b6332e0f14 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:30.305014 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a686f341-692b-4b46-92d5-11b6332e0f14 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:30.307978 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a686f341-692b-4b46-92d5-11b6332e0f14 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:30.312824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a686f341-692b-4b46-92d5-11b6332e0f14 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:30.314107 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a686f341-692b-4b46-92d5-11b6332e0f14 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:30.315446 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a686f341-692b-4b46-92d5-11b6332e0f14 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:31.098701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a686f341-692b-4b46-92d5-11b6332e0f14 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:31.098701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a686f341-692b-4b46-92d5-11b6332e0f14 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.816853 Aug 24 17:49:31.098701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 29/53] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:30 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:31.227011 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-45bdb137-19aa-4db4-a1cd-06e92f5a388f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:31.228385 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-45bdb137-19aa-4db4-a1cd-06e92f5a388f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:31.240030 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45bdb137-19aa-4db4-a1cd-06e92f5a388f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:31.240864 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45bdb137-19aa-4db4-a1cd-06e92f5a388f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:31.241514 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45bdb137-19aa-4db4-a1cd-06e92f5a388f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:31.243662 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45bdb137-19aa-4db4-a1cd-06e92f5a388f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:31.244320 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45bdb137-19aa-4db4-a1cd-06e92f5a388f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:31.246599 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45bdb137-19aa-4db4-a1cd-06e92f5a388f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:31.385135 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-45bdb137-19aa-4db4-a1cd-06e92f5a388f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:31.395417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-45bdb137-19aa-4db4-a1cd-06e92f5a388f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1236 microversion: 2.1 time: 0.190557 Aug 24 17:49:31.403673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 30/54] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:31 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1236 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:31.582417 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-465b21ac-c66f-43fe-8c60-c71a06bb15d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Flavor limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:49:31.583421 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-465b21ac-c66f-43fe-8c60-c71a06bb15d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Image limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:49:31.584447 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-465b21ac-c66f-43fe-8c60-c71a06bb15d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Flavor pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:49:31.593400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-465b21ac-c66f-43fe-8c60-c71a06bb15d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Image pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:49:31.594046 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-465b21ac-c66f-43fe-8c60-c71a06bb15d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:49:31.625198 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-465b21ac-c66f-43fe-8c60-c71a06bb15d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:31.628938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-465b21ac-c66f-43fe-8c60-c71a06bb15d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:31.629520 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-465b21ac-c66f-43fe-8c60-c71a06bb15d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:31.637141 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-465b21ac-c66f-43fe-8c60-c71a06bb15d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:31.637141 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-465b21ac-c66f-43fe-8c60-c71a06bb15d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:31.637566 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-465b21ac-c66f-43fe-8c60-c71a06bb15d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:31.726580 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-465b21ac-c66f-43fe-8c60-c71a06bb15d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Getting quotas for project 40256802535d4aedb2541246a687ec76. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:49:31.735066 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-465b21ac-c66f-43fe-8c60-c71a06bb15d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Getting quotas for user 2b6b0d0cbdb54a46a7e9d6936c47cc4c and project 40256802535d4aedb2541246a687ec76. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:49:31.769408 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-465b21ac-c66f-43fe-8c60-c71a06bb15d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Going to run 1 instances... {{(pid=127676) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:49:31.775701 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-465b21ac-c66f-43fe-8c60-c71a06bb15d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d76d745-abc6-4a7b-b8d7-46566b66934b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:49:32.105734 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-465b21ac-c66f-43fe-8c60-c71a06bb15d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 3.832191 Aug 24 17:49:32.108754 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9867dfff-9c8f-4d18-80d4-46728a679558 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:32.109539 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 25/55] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 17:49:28 2022] POST /compute/v2.1/servers => generated 400 bytes in 3838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:49:32.109806 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9867dfff-9c8f-4d18-80d4-46728a679558 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:32.126549 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b073546c-eec3-4229-913e-84ad188fc07f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:32.137231 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-b073546c-eec3-4229-913e-84ad188fc07f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:32.143228 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9867dfff-9c8f-4d18-80d4-46728a679558 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:32.149486 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9867dfff-9c8f-4d18-80d4-46728a679558 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:32.152954 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9867dfff-9c8f-4d18-80d4-46728a679558 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:32.154441 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9867dfff-9c8f-4d18-80d4-46728a679558 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:32.166933 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9867dfff-9c8f-4d18-80d4-46728a679558 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:32.167681 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9867dfff-9c8f-4d18-80d4-46728a679558 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:32.751927 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b073546c-eec3-4229-913e-84ad188fc07f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:32.761665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b073546c-eec3-4229-913e-84ad188fc07f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1237 microversion: 2.1 time: 0.644288 Aug 24 17:49:32.766214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 26/56] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:32 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1237 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:32.777542 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7b984a3d-7073-4b32-8b04-cf6253121c9f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:32.790915 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7b984a3d-7073-4b32-8b04-cf6253121c9f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:32.808398 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7b984a3d-7073-4b32-8b04-cf6253121c9f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:32.816217 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7b984a3d-7073-4b32-8b04-cf6253121c9f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:32.817138 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7b984a3d-7073-4b32-8b04-cf6253121c9f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:32.819191 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7b984a3d-7073-4b32-8b04-cf6253121c9f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:32.819965 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7b984a3d-7073-4b32-8b04-cf6253121c9f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:32.821102 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7b984a3d-7073-4b32-8b04-cf6253121c9f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:32.993884 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9867dfff-9c8f-4d18-80d4-46728a679558 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:33.031663 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9867dfff-9c8f-4d18-80d4-46728a679558 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.925370 Aug 24 17:49:33.036943 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 31/57] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:32 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:33.136338 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7b984a3d-7073-4b32-8b04-cf6253121c9f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:33.154326 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7b984a3d-7073-4b32-8b04-cf6253121c9f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1300 microversion: 2.1 time: 0.385605 Aug 24 17:49:33.156576 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 27/58] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:32 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1300 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:33.409104 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-7f2ed2c2-29c9-4e84-bdd7-b3ea0f0333b1 req-d1b06631-c79c-4c98-95be-94fa30ee4c4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cdde8bf-31af-4304-8f4e-025156ca51db", "tag": "50953070-74ca-4fab-9f1c-1e78ed898180"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:33.421904 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-7f2ed2c2-29c9-4e84-bdd7-b3ea0f0333b1 req-d1b06631-c79c-4c98-95be-94fa30ee4c4b service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:33.422373 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-7f2ed2c2-29c9-4e84-bdd7-b3ea0f0333b1 req-d1b06631-c79c-4c98-95be-94fa30ee4c4b service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:33.422818 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-7f2ed2c2-29c9-4e84-bdd7-b3ea0f0333b1 req-d1b06631-c79c-4c98-95be-94fa30ee4c4b service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:33.444842 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-7f2ed2c2-29c9-4e84-bdd7-b3ea0f0333b1 req-d1b06631-c79c-4c98-95be-94fa30ee4c4b service nova] Creating event network-changed:50953070-74ca-4fab-9f1c-1e78ed898180 for instance 4cdde8bf-31af-4304-8f4e-025156ca51db on hv-cinder-85442 Aug 24 17:49:33.445546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-7f2ed2c2-29c9-4e84-bdd7-b3ea0f0333b1 req-d1b06631-c79c-4c98-95be-94fa30ee4c4b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127677) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 17:49:33.446040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-7f2ed2c2-29c9-4e84-bdd7-b3ea0f0333b1 req-d1b06631-c79c-4c98-95be-94fa30ee4c4b service nova] Acquired lock "compute-rpcapi-router" {{(pid=127677) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 17:49:33.447141 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee682e63-a2b8-46c9-ade9-4f0f81a520de None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:33.447612 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee682e63-a2b8-46c9-ade9-4f0f81a520de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:33.448086 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee682e63-a2b8-46c9-ade9-4f0f81a520de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:33.448852 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee682e63-a2b8-46c9-ade9-4f0f81a520de None None] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:33.449475 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee682e63-a2b8-46c9-ade9-4f0f81a520de None None] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:33.449937 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee682e63-a2b8-46c9-ade9-4f0f81a520de None None] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:33.461756 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.compute.rpcapi [None req-ee682e63-a2b8-46c9-ade9-4f0f81a520de None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 17:49:33.461756 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee682e63-a2b8-46c9-ade9-4f0f81a520de None None] Releasing lock "compute-rpcapi-router" {{(pid=127677) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 17:49:33.476716 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ee682e63-a2b8-46c9-ade9-4f0f81a520de None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140985 Aug 24 17:49:33.477412 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 32/59] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:33.790454 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-2c7006c0-29b5-4c5b-b54b-d80bf2f03dcd tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:33.791089 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-2c7006c0-29b5-4c5b-b54b-d80bf2f03dcd tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:33.861942 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-2c7006c0-29b5-4c5b-b54b-d80bf2f03dcd tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:33.874013 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-2c7006c0-29b5-4c5b-b54b-d80bf2f03dcd tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1237 microversion: 2.1 time: 0.086544 Aug 24 17:49:33.897134 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 28/60] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:33 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1237 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:34.058772 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-b0d3d11d-7826-427a-8c4e-4dd6c99e9905 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:34.060048 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-b0d3d11d-7826-427a-8c4e-4dd6c99e9905 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:34.084021 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b0d3d11d-7826-427a-8c4e-4dd6c99e9905 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:34.084782 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b0d3d11d-7826-427a-8c4e-4dd6c99e9905 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:34.085387 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b0d3d11d-7826-427a-8c4e-4dd6c99e9905 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:34.088053 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b0d3d11d-7826-427a-8c4e-4dd6c99e9905 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:34.093734 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b0d3d11d-7826-427a-8c4e-4dd6c99e9905 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:34.095328 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b0d3d11d-7826-427a-8c4e-4dd6c99e9905 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:34.184444 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-77a62fe4-23a2-4fe7-8422-d89e208b8dd5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:34.185796 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-77a62fe4-23a2-4fe7-8422-d89e208b8dd5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:34.192035 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-77a62fe4-23a2-4fe7-8422-d89e208b8dd5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:34.192787 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-77a62fe4-23a2-4fe7-8422-d89e208b8dd5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:34.193378 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-77a62fe4-23a2-4fe7-8422-d89e208b8dd5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:34.194718 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-77a62fe4-23a2-4fe7-8422-d89e208b8dd5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:34.200780 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-77a62fe4-23a2-4fe7-8422-d89e208b8dd5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:34.201572 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-77a62fe4-23a2-4fe7-8422-d89e208b8dd5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:34.289027 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-77a62fe4-23a2-4fe7-8422-d89e208b8dd5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:34.304435 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-77a62fe4-23a2-4fe7-8422-d89e208b8dd5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1300 microversion: 2.1 time: 0.123609 Aug 24 17:49:34.305142 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 29/61] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:34 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1300 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:34.314812 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-fcdbd3cb-44d7-4ea1-91f9-4dce886644b2 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-695722761", "imageRef": "2d76d745-abc6-4a7b-b8d7-46566b66934b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "010bcf84-2f06-4274-8553-0a7884f5d83e"}], "security_groups": [{"name": "tempest-securitygroup--619819059"}], "key_name": "tempest-keypair-197525532", "user_data": "}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:34.453677 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-b0d3d11d-7826-427a-8c4e-4dd6c99e9905 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:34.467638 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-b0d3d11d-7826-427a-8c4e-4dd6c99e9905 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.413972 Aug 24 17:49:34.474472 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 33/62] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:34 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:34.511992 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.network.neutron [None req-fcdbd3cb-44d7-4ea1-91f9-4dce886644b2 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] validate_networks() for [('010bcf84-2f06-4274-8553-0a7884f5d83e', None, None, None, None, None)] {{(pid=127676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:49:34.910000 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-7e91691a-fb2c-4333-9c49-f8f44f075e9f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:34.910853 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-7e91691a-fb2c-4333-9c49-f8f44f075e9f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:34.925469 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7e91691a-fb2c-4333-9c49-f8f44f075e9f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:34.925979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7e91691a-fb2c-4333-9c49-f8f44f075e9f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:34.926585 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7e91691a-fb2c-4333-9c49-f8f44f075e9f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:34.927420 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7e91691a-fb2c-4333-9c49-f8f44f075e9f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:34.928017 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7e91691a-fb2c-4333-9c49-f8f44f075e9f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:34.928462 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7e91691a-fb2c-4333-9c49-f8f44f075e9f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.072277 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7e91691a-fb2c-4333-9c49-f8f44f075e9f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:35.083697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-7e91691a-fb2c-4333-9c49-f8f44f075e9f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1241 microversion: 2.1 time: 0.183395 Aug 24 17:49:35.084670 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 34/63] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:34 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1241 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:35.101389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-fcdbd3cb-44d7-4ea1-91f9-4dce886644b2 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Flavor limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:49:35.102411 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-fcdbd3cb-44d7-4ea1-91f9-4dce886644b2 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Image limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:49:35.103073 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-fcdbd3cb-44d7-4ea1-91f9-4dce886644b2 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Flavor pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:49:35.103654 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-fcdbd3cb-44d7-4ea1-91f9-4dce886644b2 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Image pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:49:35.104220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-fcdbd3cb-44d7-4ea1-91f9-4dce886644b2 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:49:35.118898 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fcdbd3cb-44d7-4ea1-91f9-4dce886644b2 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:35.118898 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fcdbd3cb-44d7-4ea1-91f9-4dce886644b2 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:35.118898 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fcdbd3cb-44d7-4ea1-91f9-4dce886644b2 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.118898 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fcdbd3cb-44d7-4ea1-91f9-4dce886644b2 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:35.120286 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fcdbd3cb-44d7-4ea1-91f9-4dce886644b2 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:35.120948 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fcdbd3cb-44d7-4ea1-91f9-4dce886644b2 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.153653 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-fcdbd3cb-44d7-4ea1-91f9-4dce886644b2 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Getting quotas for project 9398272c7a3f4a50a38df4b5dec9ac90. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:49:35.158993 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-fcdbd3cb-44d7-4ea1-91f9-4dce886644b2 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Getting quotas for user 612dfebb8ebc401bb81d3d3333577566 and project 9398272c7a3f4a50a38df4b5dec9ac90. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:49:35.170769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-fcdbd3cb-44d7-4ea1-91f9-4dce886644b2 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Going to run 1 instances... {{(pid=127676) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:49:35.173324 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-fcdbd3cb-44d7-4ea1-91f9-4dce886644b2 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d76d745-abc6-4a7b-b8d7-46566b66934b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:49:35.294719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-fcdbd3cb-44d7-4ea1-91f9-4dce886644b2 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.988027 Aug 24 17:49:35.295924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 30/64] 10.222.0.76 () {62 vars in 1188 bytes} [Wed Aug 24 17:49:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 17:49:35.308714 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c5ee6ca7-ef2d-465d-954a-ba90e9d61465 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:35.309605 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c5ee6ca7-ef2d-465d-954a-ba90e9d61465 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:35.329721 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8759e167-f13c-4a7b-8534-8635432c193a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:35.331177 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8759e167-f13c-4a7b-8534-8635432c193a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:35.355119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8759e167-f13c-4a7b-8534-8635432c193a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:35.355643 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8759e167-f13c-4a7b-8534-8635432c193a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:35.356092 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8759e167-f13c-4a7b-8534-8635432c193a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.361839 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8759e167-f13c-4a7b-8534-8635432c193a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:35.362683 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8759e167-f13c-4a7b-8534-8635432c193a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:35.363150 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8759e167-f13c-4a7b-8534-8635432c193a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.406895 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c5ee6ca7-ef2d-465d-954a-ba90e9d61465 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:35.423973 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c5ee6ca7-ef2d-465d-954a-ba90e9d61465 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:35.427158 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c5ee6ca7-ef2d-465d-954a-ba90e9d61465 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:35.430232 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c5ee6ca7-ef2d-465d-954a-ba90e9d61465 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1280 microversion: 2.20 time: 0.125039 Aug 24 17:49:35.442172 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 35/65] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:35 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1280 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:35.498982 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3601aa14-883a-43f7-95b1-cc1a67e88102 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:35.499614 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8759e167-f13c-4a7b-8534-8635432c193a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:35.499844 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3601aa14-883a-43f7-95b1-cc1a67e88102 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:35.507136 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3601aa14-883a-43f7-95b1-cc1a67e88102 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:35.508177 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3601aa14-883a-43f7-95b1-cc1a67e88102 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:35.508997 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3601aa14-883a-43f7-95b1-cc1a67e88102 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.510226 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-8759e167-f13c-4a7b-8534-8635432c193a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1300 microversion: 2.1 time: 0.184578 Aug 24 17:49:35.510368 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3601aa14-883a-43f7-95b1-cc1a67e88102 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:35.510876 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3601aa14-883a-43f7-95b1-cc1a67e88102 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:35.512216 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3601aa14-883a-43f7-95b1-cc1a67e88102 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.522977 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 31/66] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:35 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1300 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:35.828105 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3601aa14-883a-43f7-95b1-cc1a67e88102 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:35.838024 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3601aa14-883a-43f7-95b1-cc1a67e88102 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.343012 Aug 24 17:49:35.854709 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 36/67] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:35 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:36.119915 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-c0d95d19-10a9-4e68-adf1-6d7d9b62ecbf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:36.121398 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-c0d95d19-10a9-4e68-adf1-6d7d9b62ecbf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:36.130210 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c0d95d19-10a9-4e68-adf1-6d7d9b62ecbf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:36.131459 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c0d95d19-10a9-4e68-adf1-6d7d9b62ecbf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:36.132487 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c0d95d19-10a9-4e68-adf1-6d7d9b62ecbf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:36.134256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c0d95d19-10a9-4e68-adf1-6d7d9b62ecbf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:36.137010 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c0d95d19-10a9-4e68-adf1-6d7d9b62ecbf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:36.137911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c0d95d19-10a9-4e68-adf1-6d7d9b62ecbf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:36.251711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c0d95d19-10a9-4e68-adf1-6d7d9b62ecbf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:36.265675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-c0d95d19-10a9-4e68-adf1-6d7d9b62ecbf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1241 microversion: 2.1 time: 0.159025 Aug 24 17:49:36.267036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 32/68] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:36 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1241 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:36.459982 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-77ca8f3f-cc97-4d4c-bac6-971a385a5ece tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:36.461258 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-77ca8f3f-cc97-4d4c-bac6-971a385a5ece tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:36.523014 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-77ca8f3f-cc97-4d4c-bac6-971a385a5ece tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:36.534393 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-77ca8f3f-cc97-4d4c-bac6-971a385a5ece tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:36.536142 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-77ca8f3f-cc97-4d4c-bac6-971a385a5ece tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:36.537754 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-77ca8f3f-cc97-4d4c-bac6-971a385a5ece tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1280 microversion: 2.20 time: 0.086302 Aug 24 17:49:36.549643 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-fd04b0ea-e6c9-44d3-96d7-a0642dd61e8e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:36.551439 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-fd04b0ea-e6c9-44d3-96d7-a0642dd61e8e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:36.566230 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 37/69] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:36 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1280 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:36.567897 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fd04b0ea-e6c9-44d3-96d7-a0642dd61e8e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:36.569316 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fd04b0ea-e6c9-44d3-96d7-a0642dd61e8e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:36.574572 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fd04b0ea-e6c9-44d3-96d7-a0642dd61e8e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:36.576575 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fd04b0ea-e6c9-44d3-96d7-a0642dd61e8e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:36.578613 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fd04b0ea-e6c9-44d3-96d7-a0642dd61e8e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:36.581250 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fd04b0ea-e6c9-44d3-96d7-a0642dd61e8e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:36.660052 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-fd04b0ea-e6c9-44d3-96d7-a0642dd61e8e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:36.685155 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-fd04b0ea-e6c9-44d3-96d7-a0642dd61e8e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1300 microversion: 2.1 time: 0.152749 Aug 24 17:49:36.700613 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 33/70] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:36 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1300 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:36.866245 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ba00898c-313a-4143-a097-c09c706368b5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:36.867622 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ba00898c-313a-4143-a097-c09c706368b5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:36.874607 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ba00898c-313a-4143-a097-c09c706368b5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:36.875450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ba00898c-313a-4143-a097-c09c706368b5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:36.876123 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ba00898c-313a-4143-a097-c09c706368b5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:36.878954 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ba00898c-313a-4143-a097-c09c706368b5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:36.879595 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ba00898c-313a-4143-a097-c09c706368b5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:36.880106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ba00898c-313a-4143-a097-c09c706368b5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:37.088023 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-ba00898c-313a-4143-a097-c09c706368b5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:37.096451 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ba00898c-313a-4143-a097-c09c706368b5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.234577 Aug 24 17:49:37.097146 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 38/71] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:36 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:37.288006 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-58bb3678-df9b-41c1-9832-9d505ae4f343 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:37.288764 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-58bb3678-df9b-41c1-9832-9d505ae4f343 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:37.299930 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58bb3678-df9b-41c1-9832-9d505ae4f343 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:37.308931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58bb3678-df9b-41c1-9832-9d505ae4f343 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:37.309474 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58bb3678-df9b-41c1-9832-9d505ae4f343 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:37.310257 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58bb3678-df9b-41c1-9832-9d505ae4f343 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:37.311977 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58bb3678-df9b-41c1-9832-9d505ae4f343 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:37.312412 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58bb3678-df9b-41c1-9832-9d505ae4f343 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:37.438543 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-58bb3678-df9b-41c1-9832-9d505ae4f343 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:37.469250 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-58bb3678-df9b-41c1-9832-9d505ae4f343 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1241 microversion: 2.1 time: 0.185334 Aug 24 17:49:37.471295 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 34/72] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:37 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1241 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:37.584161 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-2485c11d-91b6-43c1-948d-f7806d0155fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:37.585618 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-2485c11d-91b6-43c1-948d-f7806d0155fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:37.609513 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2485c11d-91b6-43c1-948d-f7806d0155fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:37.611707 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2485c11d-91b6-43c1-948d-f7806d0155fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:37.612219 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2485c11d-91b6-43c1-948d-f7806d0155fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:37.613193 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2485c11d-91b6-43c1-948d-f7806d0155fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:37.617717 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2485c11d-91b6-43c1-948d-f7806d0155fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:37.618232 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2485c11d-91b6-43c1-948d-f7806d0155fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:37.702968 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-2485c11d-91b6-43c1-948d-f7806d0155fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:37.719900 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-3f2316ac-f485-47d6-b0fd-3bcbdefb2353 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:37.720381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-2485c11d-91b6-43c1-948d-f7806d0155fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:37.724209 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-2485c11d-91b6-43c1-948d-f7806d0155fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:37.725420 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-2485c11d-91b6-43c1-948d-f7806d0155fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1284 microversion: 2.20 time: 0.148842 Aug 24 17:49:37.729162 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 39/73] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:37 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:37.743121 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-3f2316ac-f485-47d6-b0fd-3bcbdefb2353 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:37.774082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:37.781763 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3f2316ac-f485-47d6-b0fd-3bcbdefb2353 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:37.783554 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3f2316ac-f485-47d6-b0fd-3bcbdefb2353 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:37.786118 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3f2316ac-f485-47d6-b0fd-3bcbdefb2353 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:37.792296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3f2316ac-f485-47d6-b0fd-3bcbdefb2353 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:37.796498 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3f2316ac-f485-47d6-b0fd-3bcbdefb2353 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:37.798918 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3f2316ac-f485-47d6-b0fd-3bcbdefb2353 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:37.978621 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-3f2316ac-f485-47d6-b0fd-3bcbdefb2353 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:38.003062 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-3f2316ac-f485-47d6-b0fd-3bcbdefb2353 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1310 microversion: 2.1 time: 0.291951 Aug 24 17:49:38.012613 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 35/74] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:37 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1310 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:38.123834 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4485591b-87c9-4c83-8622-9d6bbb792b0d tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:38.124825 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4485591b-87c9-4c83-8622-9d6bbb792b0d tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:38.139589 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4485591b-87c9-4c83-8622-9d6bbb792b0d tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:38.140609 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4485591b-87c9-4c83-8622-9d6bbb792b0d tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:38.141498 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4485591b-87c9-4c83-8622-9d6bbb792b0d tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:38.143046 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4485591b-87c9-4c83-8622-9d6bbb792b0d tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:38.144954 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4485591b-87c9-4c83-8622-9d6bbb792b0d tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:38.144954 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4485591b-87c9-4c83-8622-9d6bbb792b0d tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:38.301711 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-4485591b-87c9-4c83-8622-9d6bbb792b0d tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:38.309751 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-4485591b-87c9-4c83-8622-9d6bbb792b0d tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.194222 Aug 24 17:49:38.310439 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 40/75] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:38 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:38.496423 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-9dfe1807-7cfd-4df7-a8ec-b8c70c37b0a0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:38.497009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-9dfe1807-7cfd-4df7-a8ec-b8c70c37b0a0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:38.503665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9dfe1807-7cfd-4df7-a8ec-b8c70c37b0a0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:38.504156 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9dfe1807-7cfd-4df7-a8ec-b8c70c37b0a0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:38.504579 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9dfe1807-7cfd-4df7-a8ec-b8c70c37b0a0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:38.505263 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9dfe1807-7cfd-4df7-a8ec-b8c70c37b0a0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:38.505725 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9dfe1807-7cfd-4df7-a8ec-b8c70c37b0a0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:38.506230 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9dfe1807-7cfd-4df7-a8ec-b8c70c37b0a0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:38.571108 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-9dfe1807-7cfd-4df7-a8ec-b8c70c37b0a0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:38.579554 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-9dfe1807-7cfd-4df7-a8ec-b8c70c37b0a0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1233 microversion: 2.1 time: 0.087282 Aug 24 17:49:38.584165 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 36/76] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:38 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1233 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:38.748973 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e48c0da5-d465-492b-8987-86d0b6a7871f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:38.749496 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-e48c0da5-d465-492b-8987-86d0b6a7871f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:38.755653 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e48c0da5-d465-492b-8987-86d0b6a7871f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:38.756138 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e48c0da5-d465-492b-8987-86d0b6a7871f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:38.756610 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e48c0da5-d465-492b-8987-86d0b6a7871f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:38.757408 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e48c0da5-d465-492b-8987-86d0b6a7871f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:38.757746 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e48c0da5-d465-492b-8987-86d0b6a7871f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:38.758200 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e48c0da5-d465-492b-8987-86d0b6a7871f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:38.820196 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e48c0da5-d465-492b-8987-86d0b6a7871f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:38.828809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e48c0da5-d465-492b-8987-86d0b6a7871f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:38.830936 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e48c0da5-d465-492b-8987-86d0b6a7871f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:38.832229 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-e48c0da5-d465-492b-8987-86d0b6a7871f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1276 microversion: 2.20 time: 0.087463 Aug 24 17:49:38.832889 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 41/77] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:38 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:39.043190 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-1c09cd08-cd7d-409a-981b-095f24914a8a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:39.043794 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-1c09cd08-cd7d-409a-981b-095f24914a8a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:39.050694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c09cd08-cd7d-409a-981b-095f24914a8a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:39.051191 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c09cd08-cd7d-409a-981b-095f24914a8a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:39.051629 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c09cd08-cd7d-409a-981b-095f24914a8a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:39.052446 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c09cd08-cd7d-409a-981b-095f24914a8a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:39.053314 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c09cd08-cd7d-409a-981b-095f24914a8a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:39.053747 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c09cd08-cd7d-409a-981b-095f24914a8a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:39.124677 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-1c09cd08-cd7d-409a-981b-095f24914a8a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:39.133179 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-1c09cd08-cd7d-409a-981b-095f24914a8a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1298 microversion: 2.1 time: 0.094376 Aug 24 17:49:39.136813 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 37/78] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:39 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:39.336628 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-b66176b2-c70b-4c4a-8549-6178e59f4ae1 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:39.337244 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-b66176b2-c70b-4c4a-8549-6178e59f4ae1 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:39.343559 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b66176b2-c70b-4c4a-8549-6178e59f4ae1 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:39.344061 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b66176b2-c70b-4c4a-8549-6178e59f4ae1 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:39.344471 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b66176b2-c70b-4c4a-8549-6178e59f4ae1 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:39.345162 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b66176b2-c70b-4c4a-8549-6178e59f4ae1 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:39.345662 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b66176b2-c70b-4c4a-8549-6178e59f4ae1 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:39.346417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b66176b2-c70b-4c4a-8549-6178e59f4ae1 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:39.497880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-b66176b2-c70b-4c4a-8549-6178e59f4ae1 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:39.510174 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-b66176b2-c70b-4c4a-8549-6178e59f4ae1 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.176205 Aug 24 17:49:39.510174 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 42/79] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:39 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:39.601498 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-38c21c2b-a618-4a87-a848-5ecb4c81cac3 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:39.602045 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-38c21c2b-a618-4a87-a848-5ecb4c81cac3 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:39.608395 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-38c21c2b-a618-4a87-a848-5ecb4c81cac3 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:39.608974 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-38c21c2b-a618-4a87-a848-5ecb4c81cac3 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:39.609418 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-38c21c2b-a618-4a87-a848-5ecb4c81cac3 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:39.610207 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-38c21c2b-a618-4a87-a848-5ecb4c81cac3 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:39.615902 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-38c21c2b-a618-4a87-a848-5ecb4c81cac3 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:39.615902 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-38c21c2b-a618-4a87-a848-5ecb4c81cac3 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:39.678368 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-38c21c2b-a618-4a87-a848-5ecb4c81cac3 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:39.685883 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-38c21c2b-a618-4a87-a848-5ecb4c81cac3 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1233 microversion: 2.1 time: 0.088435 Aug 24 17:49:39.686668 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 38/80] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:39 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1233 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:39.857871 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-7052f4ed-76de-4a8b-b580-1a21caa1504d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:39.858498 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-7052f4ed-76de-4a8b-b580-1a21caa1504d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:39.865265 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7052f4ed-76de-4a8b-b580-1a21caa1504d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:39.865753 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7052f4ed-76de-4a8b-b580-1a21caa1504d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:39.866234 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7052f4ed-76de-4a8b-b580-1a21caa1504d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:39.866929 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7052f4ed-76de-4a8b-b580-1a21caa1504d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:39.867474 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7052f4ed-76de-4a8b-b580-1a21caa1504d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:39.867901 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7052f4ed-76de-4a8b-b580-1a21caa1504d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:39.939416 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7052f4ed-76de-4a8b-b580-1a21caa1504d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:39.948261 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7052f4ed-76de-4a8b-b580-1a21caa1504d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:39.949781 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7052f4ed-76de-4a8b-b580-1a21caa1504d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:39.950969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-7052f4ed-76de-4a8b-b580-1a21caa1504d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1276 microversion: 2.20 time: 0.097159 Aug 24 17:49:39.953673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 43/81] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:39 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1276 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:40.155707 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b6d9438d-3097-47b0-8c4f-3cb7c39c0008 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:40.156324 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-b6d9438d-3097-47b0-8c4f-3cb7c39c0008 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:40.162372 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b6d9438d-3097-47b0-8c4f-3cb7c39c0008 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:40.162851 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b6d9438d-3097-47b0-8c4f-3cb7c39c0008 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:40.163280 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b6d9438d-3097-47b0-8c4f-3cb7c39c0008 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:40.163971 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b6d9438d-3097-47b0-8c4f-3cb7c39c0008 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:40.164424 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b6d9438d-3097-47b0-8c4f-3cb7c39c0008 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:40.164844 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b6d9438d-3097-47b0-8c4f-3cb7c39c0008 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:40.235867 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b6d9438d-3097-47b0-8c4f-3cb7c39c0008 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:40.244883 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b6d9438d-3097-47b0-8c4f-3cb7c39c0008 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1298 microversion: 2.1 time: 0.093139 Aug 24 17:49:40.245917 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 39/82] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:40 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:40.531865 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-bf5e1c51-6ec0-4b0b-995b-e25c82296eee tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:40.532717 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-bf5e1c51-6ec0-4b0b-995b-e25c82296eee tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:40.543185 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bf5e1c51-6ec0-4b0b-995b-e25c82296eee tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:40.543996 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bf5e1c51-6ec0-4b0b-995b-e25c82296eee tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:40.544592 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bf5e1c51-6ec0-4b0b-995b-e25c82296eee tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:40.545545 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bf5e1c51-6ec0-4b0b-995b-e25c82296eee tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:40.546272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bf5e1c51-6ec0-4b0b-995b-e25c82296eee tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:40.550233 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bf5e1c51-6ec0-4b0b-995b-e25c82296eee tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:40.565696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=100 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:40.713341 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-6ebf281b-32c0-4f31-a2f6-5264402dc43a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:40.714357 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-6ebf281b-32c0-4f31-a2f6-5264402dc43a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:40.729243 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6ebf281b-32c0-4f31-a2f6-5264402dc43a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:40.729888 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6ebf281b-32c0-4f31-a2f6-5264402dc43a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:40.730665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6ebf281b-32c0-4f31-a2f6-5264402dc43a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:40.731177 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6ebf281b-32c0-4f31-a2f6-5264402dc43a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:40.731774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6ebf281b-32c0-4f31-a2f6-5264402dc43a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:40.732203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6ebf281b-32c0-4f31-a2f6-5264402dc43a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:40.760913 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-bf5e1c51-6ec0-4b0b-995b-e25c82296eee tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:40.773343 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-bf5e1c51-6ec0-4b0b-995b-e25c82296eee tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.247601 Aug 24 17:49:40.775097 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 44/83] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:40 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:40.859766 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-6ebf281b-32c0-4f31-a2f6-5264402dc43a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:40.874361 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-6ebf281b-32c0-4f31-a2f6-5264402dc43a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1233 microversion: 2.1 time: 0.166126 Aug 24 17:49:40.875285 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 40/84] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:40 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1233 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:40.978433 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1aea900a-56dc-41b9-8997-fe217ae1b01d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:40.979364 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1aea900a-56dc-41b9-8997-fe217ae1b01d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:40.985613 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1aea900a-56dc-41b9-8997-fe217ae1b01d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:40.986690 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1aea900a-56dc-41b9-8997-fe217ae1b01d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:40.987338 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1aea900a-56dc-41b9-8997-fe217ae1b01d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:40.988343 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1aea900a-56dc-41b9-8997-fe217ae1b01d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:40.989013 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1aea900a-56dc-41b9-8997-fe217ae1b01d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:40.989671 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1aea900a-56dc-41b9-8997-fe217ae1b01d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:41.078688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1aea900a-56dc-41b9-8997-fe217ae1b01d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:41.088048 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1aea900a-56dc-41b9-8997-fe217ae1b01d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:41.089575 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1aea900a-56dc-41b9-8997-fe217ae1b01d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:41.090939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1aea900a-56dc-41b9-8997-fe217ae1b01d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1276 microversion: 2.20 time: 0.121168 Aug 24 17:49:41.102001 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 45/85] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:40 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1276 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:41.270902 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f9be5145-3947-484d-8931-773e7fde233b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:41.271966 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f9be5145-3947-484d-8931-773e7fde233b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:41.285875 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f9be5145-3947-484d-8931-773e7fde233b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:41.286978 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f9be5145-3947-484d-8931-773e7fde233b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:41.287648 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f9be5145-3947-484d-8931-773e7fde233b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:41.288533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f9be5145-3947-484d-8931-773e7fde233b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:41.289248 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f9be5145-3947-484d-8931-773e7fde233b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:41.289884 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f9be5145-3947-484d-8931-773e7fde233b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:41.399768 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f9be5145-3947-484d-8931-773e7fde233b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:41.419952 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f9be5145-3947-484d-8931-773e7fde233b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1298 microversion: 2.1 time: 0.158190 Aug 24 17:49:41.421888 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 41/86] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:41 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1298 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:41.800327 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-7f8cde8b-944c-4877-aaa1-113d7df00385 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:41.801027 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-7f8cde8b-944c-4877-aaa1-113d7df00385 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:41.810687 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:41.813452 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7f8cde8b-944c-4877-aaa1-113d7df00385 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:41.814843 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7f8cde8b-944c-4877-aaa1-113d7df00385 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:41.815686 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7f8cde8b-944c-4877-aaa1-113d7df00385 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:41.817366 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7f8cde8b-944c-4877-aaa1-113d7df00385 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:41.818606 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7f8cde8b-944c-4877-aaa1-113d7df00385 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:41.819652 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7f8cde8b-944c-4877-aaa1-113d7df00385 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:41.905309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5b13c0c8-bc2d-4141-8bb5-f27919953f4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:41.907277 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5b13c0c8-bc2d-4141-8bb5-f27919953f4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:41.921275 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b13c0c8-bc2d-4141-8bb5-f27919953f4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:41.921756 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b13c0c8-bc2d-4141-8bb5-f27919953f4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:41.922260 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b13c0c8-bc2d-4141-8bb5-f27919953f4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:41.925821 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b13c0c8-bc2d-4141-8bb5-f27919953f4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:41.926569 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b13c0c8-bc2d-4141-8bb5-f27919953f4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:41.927151 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b13c0c8-bc2d-4141-8bb5-f27919953f4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:42.054839 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5b13c0c8-bc2d-4141-8bb5-f27919953f4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:42.067766 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5b13c0c8-bc2d-4141-8bb5-f27919953f4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1233 microversion: 2.1 time: 0.168656 Aug 24 17:49:42.068351 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 42/87] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:41 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1233 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:42.090813 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7f8cde8b-944c-4877-aaa1-113d7df00385 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:42.099710 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-7f8cde8b-944c-4877-aaa1-113d7df00385 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.305005 Aug 24 17:49:42.114328 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 46/88] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:41 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:42.120571 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a2468252-84f2-4f50-82aa-3761b7960636 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:42.121394 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a2468252-84f2-4f50-82aa-3761b7960636 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:42.136807 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a2468252-84f2-4f50-82aa-3761b7960636 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:42.137747 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a2468252-84f2-4f50-82aa-3761b7960636 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:42.138682 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a2468252-84f2-4f50-82aa-3761b7960636 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:42.141211 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a2468252-84f2-4f50-82aa-3761b7960636 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:42.143704 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a2468252-84f2-4f50-82aa-3761b7960636 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:42.146024 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a2468252-84f2-4f50-82aa-3761b7960636 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:42.253410 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a2468252-84f2-4f50-82aa-3761b7960636 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:42.273620 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=100 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:42.290903 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a2468252-84f2-4f50-82aa-3761b7960636 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:42.292956 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a2468252-84f2-4f50-82aa-3761b7960636 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:42.294545 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a2468252-84f2-4f50-82aa-3761b7960636 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1276 microversion: 2.20 time: 0.179080 Aug 24 17:49:42.295400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 43/89] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:42 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1276 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:49:42.448617 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f395224b-4b06-4123-95c5-4b5f59a749cf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:42.449696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-f395224b-4b06-4123-95c5-4b5f59a749cf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:42.470315 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f395224b-4b06-4123-95c5-4b5f59a749cf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:42.473436 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f395224b-4b06-4123-95c5-4b5f59a749cf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:42.474285 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f395224b-4b06-4123-95c5-4b5f59a749cf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:42.475493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f395224b-4b06-4123-95c5-4b5f59a749cf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:42.476274 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f395224b-4b06-4123-95c5-4b5f59a749cf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:42.477328 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f395224b-4b06-4123-95c5-4b5f59a749cf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:42.576520 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f395224b-4b06-4123-95c5-4b5f59a749cf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:42.585984 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-f395224b-4b06-4123-95c5-4b5f59a749cf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1298 microversion: 2.1 time: 0.145746 Aug 24 17:49:42.586674 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 47/90] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:42 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1298 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:43.095128 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-db013b97-1c3d-4da3-a517-2810cb967b05 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:43.096661 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-db013b97-1c3d-4da3-a517-2810cb967b05 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:43.103319 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-db013b97-1c3d-4da3-a517-2810cb967b05 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:43.103972 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-db013b97-1c3d-4da3-a517-2810cb967b05 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:43.104523 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-db013b97-1c3d-4da3-a517-2810cb967b05 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:43.105238 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-db013b97-1c3d-4da3-a517-2810cb967b05 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:43.105692 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-db013b97-1c3d-4da3-a517-2810cb967b05 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:43.106321 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-db013b97-1c3d-4da3-a517-2810cb967b05 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:43.139277 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-5aff0c2d-cff5-40cb-bf1d-e33668ee641f tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:43.139817 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-5aff0c2d-cff5-40cb-bf1d-e33668ee641f tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:43.152872 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5aff0c2d-cff5-40cb-bf1d-e33668ee641f tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:43.153646 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5aff0c2d-cff5-40cb-bf1d-e33668ee641f tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:43.154308 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5aff0c2d-cff5-40cb-bf1d-e33668ee641f tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:43.155585 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5aff0c2d-cff5-40cb-bf1d-e33668ee641f tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:43.156086 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5aff0c2d-cff5-40cb-bf1d-e33668ee641f tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:43.156619 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5aff0c2d-cff5-40cb-bf1d-e33668ee641f tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:43.178617 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-db013b97-1c3d-4da3-a517-2810cb967b05 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:43.187262 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-db013b97-1c3d-4da3-a517-2810cb967b05 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1233 microversion: 2.1 time: 0.096409 Aug 24 17:49:43.194079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 44/91] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:43 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1233 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:43.315914 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5aff0c2d-cff5-40cb-bf1d-e33668ee641f tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:43.323886 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-5aff0c2d-cff5-40cb-bf1d-e33668ee641f tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.188449 Aug 24 17:49:43.324470 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 48/92] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:43 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:43.337473 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-595a745f-9f4b-4d45-817f-73fcf3f9df0f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:43.338725 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-595a745f-9f4b-4d45-817f-73fcf3f9df0f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:43.350036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-595a745f-9f4b-4d45-817f-73fcf3f9df0f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:43.350973 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-595a745f-9f4b-4d45-817f-73fcf3f9df0f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:43.351770 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-595a745f-9f4b-4d45-817f-73fcf3f9df0f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:43.353038 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-595a745f-9f4b-4d45-817f-73fcf3f9df0f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:43.353882 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-595a745f-9f4b-4d45-817f-73fcf3f9df0f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:43.354708 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-595a745f-9f4b-4d45-817f-73fcf3f9df0f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:43.442906 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-595a745f-9f4b-4d45-817f-73fcf3f9df0f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:43.456306 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-595a745f-9f4b-4d45-817f-73fcf3f9df0f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:43.458072 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-595a745f-9f4b-4d45-817f-73fcf3f9df0f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:43.459355 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-595a745f-9f4b-4d45-817f-73fcf3f9df0f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1332 microversion: 2.20 time: 0.129914 Aug 24 17:49:43.459909 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 45/93] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:43 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1332 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:43.617402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3eea6c56-1fc1-4ac1-9ef5-c8b4571f2a0f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:43.618133 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3eea6c56-1fc1-4ac1-9ef5-c8b4571f2a0f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:43.623323 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=6 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:43.625401 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3eea6c56-1fc1-4ac1-9ef5-c8b4571f2a0f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:43.626006 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3eea6c56-1fc1-4ac1-9ef5-c8b4571f2a0f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:43.627857 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3eea6c56-1fc1-4ac1-9ef5-c8b4571f2a0f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:43.628012 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3eea6c56-1fc1-4ac1-9ef5-c8b4571f2a0f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:43.628611 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3eea6c56-1fc1-4ac1-9ef5-c8b4571f2a0f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:43.629145 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3eea6c56-1fc1-4ac1-9ef5-c8b4571f2a0f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:43.694167 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3eea6c56-1fc1-4ac1-9ef5-c8b4571f2a0f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:43.701885 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3eea6c56-1fc1-4ac1-9ef5-c8b4571f2a0f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1298 microversion: 2.1 time: 0.088348 Aug 24 17:49:43.702771 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 49/94] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:43 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:44.209278 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ec183045-710d-44fc-8c38-020d1874fbbe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:44.210014 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-ec183045-710d-44fc-8c38-020d1874fbbe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:44.216298 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ec183045-710d-44fc-8c38-020d1874fbbe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:44.216784 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ec183045-710d-44fc-8c38-020d1874fbbe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:44.217216 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ec183045-710d-44fc-8c38-020d1874fbbe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:44.217945 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ec183045-710d-44fc-8c38-020d1874fbbe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:44.218403 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ec183045-710d-44fc-8c38-020d1874fbbe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:44.218852 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ec183045-710d-44fc-8c38-020d1874fbbe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:44.289769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-ec183045-710d-44fc-8c38-020d1874fbbe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:44.300682 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-ec183045-710d-44fc-8c38-020d1874fbbe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1289 microversion: 2.1 time: 0.095716 Aug 24 17:49:44.301287 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 46/95] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:44 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:44.346174 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ae170793-5cb5-42aa-a79c-bef60f25bfb9 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:44.346800 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ae170793-5cb5-42aa-a79c-bef60f25bfb9 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:44.353633 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ae170793-5cb5-42aa-a79c-bef60f25bfb9 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:44.354164 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ae170793-5cb5-42aa-a79c-bef60f25bfb9 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:44.354602 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ae170793-5cb5-42aa-a79c-bef60f25bfb9 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:44.355300 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ae170793-5cb5-42aa-a79c-bef60f25bfb9 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:44.355754 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ae170793-5cb5-42aa-a79c-bef60f25bfb9 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:44.356454 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ae170793-5cb5-42aa-a79c-bef60f25bfb9 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:44.483230 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-25c7a6e4-8926-4a07-b81c-ef941418d5f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:44.484073 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-25c7a6e4-8926-4a07-b81c-ef941418d5f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:44.490807 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-25c7a6e4-8926-4a07-b81c-ef941418d5f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:44.491299 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-25c7a6e4-8926-4a07-b81c-ef941418d5f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:44.491729 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-25c7a6e4-8926-4a07-b81c-ef941418d5f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:44.492590 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-25c7a6e4-8926-4a07-b81c-ef941418d5f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:44.493042 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-25c7a6e4-8926-4a07-b81c-ef941418d5f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:44.493492 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-25c7a6e4-8926-4a07-b81c-ef941418d5f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:44.511606 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-ae170793-5cb5-42aa-a79c-bef60f25bfb9 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:44.519921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ae170793-5cb5-42aa-a79c-bef60f25bfb9 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.178071 Aug 24 17:49:44.520633 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 50/96] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:44 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:44.569503 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-25c7a6e4-8926-4a07-b81c-ef941418d5f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:44.586941 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-25c7a6e4-8926-4a07-b81c-ef941418d5f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:44.590316 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-25c7a6e4-8926-4a07-b81c-ef941418d5f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:44.591083 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-25c7a6e4-8926-4a07-b81c-ef941418d5f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1332 microversion: 2.20 time: 0.111464 Aug 24 17:49:44.592221 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 47/97] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:44 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1332 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:44.723390 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0520425f-30bf-4c7a-8c66-bd93d0e09c10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:44.724037 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0520425f-30bf-4c7a-8c66-bd93d0e09c10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:44.730224 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0520425f-30bf-4c7a-8c66-bd93d0e09c10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:44.730712 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0520425f-30bf-4c7a-8c66-bd93d0e09c10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:44.731290 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0520425f-30bf-4c7a-8c66-bd93d0e09c10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:44.731984 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0520425f-30bf-4c7a-8c66-bd93d0e09c10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:44.732444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0520425f-30bf-4c7a-8c66-bd93d0e09c10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:44.732868 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0520425f-30bf-4c7a-8c66-bd93d0e09c10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:44.812045 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0520425f-30bf-4c7a-8c66-bd93d0e09c10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:44.821012 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0520425f-30bf-4c7a-8c66-bd93d0e09c10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1298 microversion: 2.1 time: 0.101440 Aug 24 17:49:44.821665 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 51/98] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:44 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:45.321437 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-c203bba1-9b42-48ce-a34e-ba9be9418e8f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:45.322232 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-c203bba1-9b42-48ce-a34e-ba9be9418e8f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:45.324173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=4 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:45.324858 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=32 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:45.330442 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c203bba1-9b42-48ce-a34e-ba9be9418e8f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:45.331046 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c203bba1-9b42-48ce-a34e-ba9be9418e8f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:45.331478 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c203bba1-9b42-48ce-a34e-ba9be9418e8f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:45.332210 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c203bba1-9b42-48ce-a34e-ba9be9418e8f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:45.332660 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c203bba1-9b42-48ce-a34e-ba9be9418e8f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:45.333096 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c203bba1-9b42-48ce-a34e-ba9be9418e8f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:45.404339 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c203bba1-9b42-48ce-a34e-ba9be9418e8f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:45.420388 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-c203bba1-9b42-48ce-a34e-ba9be9418e8f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1289 microversion: 2.1 time: 0.102595 Aug 24 17:49:45.421482 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 48/99] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:45 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1289 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:45.542833 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-17232128-8cde-4c47-8b90-b0c084dfafb8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:45.543446 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-17232128-8cde-4c47-8b90-b0c084dfafb8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:45.550434 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-17232128-8cde-4c47-8b90-b0c084dfafb8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:45.550909 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-17232128-8cde-4c47-8b90-b0c084dfafb8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:45.551351 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-17232128-8cde-4c47-8b90-b0c084dfafb8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:45.552049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-17232128-8cde-4c47-8b90-b0c084dfafb8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:45.552501 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-17232128-8cde-4c47-8b90-b0c084dfafb8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:45.552992 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-17232128-8cde-4c47-8b90-b0c084dfafb8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:45.626879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-56532ee1-361b-4a45-ac20-970893c895b8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:45.627389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-56532ee1-361b-4a45-ac20-970893c895b8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:45.634284 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-56532ee1-361b-4a45-ac20-970893c895b8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:45.635490 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-56532ee1-361b-4a45-ac20-970893c895b8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:45.635490 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-56532ee1-361b-4a45-ac20-970893c895b8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:45.635999 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-56532ee1-361b-4a45-ac20-970893c895b8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:45.636541 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-56532ee1-361b-4a45-ac20-970893c895b8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:45.636979 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-56532ee1-361b-4a45-ac20-970893c895b8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:45.725905 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-56532ee1-361b-4a45-ac20-970893c895b8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:45.729903 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-17232128-8cde-4c47-8b90-b0c084dfafb8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:45.735405 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-56532ee1-361b-4a45-ac20-970893c895b8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:45.737663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-56532ee1-361b-4a45-ac20-970893c895b8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:45.739015 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-17232128-8cde-4c47-8b90-b0c084dfafb8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.200289 Aug 24 17:49:45.739132 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-56532ee1-361b-4a45-ac20-970893c895b8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1332 microversion: 2.20 time: 0.116355 Aug 24 17:49:45.739586 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 49/100] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:45 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:49:45.754303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 52/101] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:45 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:45.844144 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-88748bdf-9bb1-49b6-917d-5f9ea6ab2a5b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:45.846153 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-88748bdf-9bb1-49b6-917d-5f9ea6ab2a5b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:45.855717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-88748bdf-9bb1-49b6-917d-5f9ea6ab2a5b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:45.856306 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-88748bdf-9bb1-49b6-917d-5f9ea6ab2a5b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:45.856818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-88748bdf-9bb1-49b6-917d-5f9ea6ab2a5b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:45.857609 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-88748bdf-9bb1-49b6-917d-5f9ea6ab2a5b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:45.858177 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-88748bdf-9bb1-49b6-917d-5f9ea6ab2a5b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:45.858604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-88748bdf-9bb1-49b6-917d-5f9ea6ab2a5b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:45.930575 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-88748bdf-9bb1-49b6-917d-5f9ea6ab2a5b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:45.940234 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-88748bdf-9bb1-49b6-917d-5f9ea6ab2a5b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1298 microversion: 2.1 time: 0.100437 Aug 24 17:49:45.941169 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 50/102] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:45 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:46.453469 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ef5e01d5-600b-437b-b2e2-04e94dc39f6c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:46.454117 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ef5e01d5-600b-437b-b2e2-04e94dc39f6c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:46.460942 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ef5e01d5-600b-437b-b2e2-04e94dc39f6c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:46.461438 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ef5e01d5-600b-437b-b2e2-04e94dc39f6c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:46.461925 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ef5e01d5-600b-437b-b2e2-04e94dc39f6c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:46.462665 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ef5e01d5-600b-437b-b2e2-04e94dc39f6c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:46.463117 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ef5e01d5-600b-437b-b2e2-04e94dc39f6c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:46.463544 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ef5e01d5-600b-437b-b2e2-04e94dc39f6c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:46.528709 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=24 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:46.549550 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-ef5e01d5-600b-437b-b2e2-04e94dc39f6c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:46.558344 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ef5e01d5-600b-437b-b2e2-04e94dc39f6c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1289 microversion: 2.1 time: 0.108680 Aug 24 17:49:46.558934 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 53/103] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:46 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1289 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:46.762988 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f9f7f805-7448-4ece-bd76-b7f9ce804530 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:46.763683 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f9f7f805-7448-4ece-bd76-b7f9ce804530 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:46.769343 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-eb66ef24-5730-4f42-afca-36da7ecab6fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:46.769343 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-eb66ef24-5730-4f42-afca-36da7ecab6fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:46.771051 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f9f7f805-7448-4ece-bd76-b7f9ce804530 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:46.771667 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f9f7f805-7448-4ece-bd76-b7f9ce804530 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:46.772178 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f9f7f805-7448-4ece-bd76-b7f9ce804530 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:46.773043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f9f7f805-7448-4ece-bd76-b7f9ce804530 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:46.773941 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f9f7f805-7448-4ece-bd76-b7f9ce804530 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:46.774542 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eb66ef24-5730-4f42-afca-36da7ecab6fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:46.774663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f9f7f805-7448-4ece-bd76-b7f9ce804530 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:46.775046 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eb66ef24-5730-4f42-afca-36da7ecab6fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:46.775487 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eb66ef24-5730-4f42-afca-36da7ecab6fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:46.776195 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eb66ef24-5730-4f42-afca-36da7ecab6fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:46.776701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eb66ef24-5730-4f42-afca-36da7ecab6fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:46.777135 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eb66ef24-5730-4f42-afca-36da7ecab6fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:47.053992 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-eb66ef24-5730-4f42-afca-36da7ecab6fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:47.068940 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-eb66ef24-5730-4f42-afca-36da7ecab6fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:47.070867 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-eb66ef24-5730-4f42-afca-36da7ecab6fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:47.072157 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-eb66ef24-5730-4f42-afca-36da7ecab6fe tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1332 microversion: 2.20 time: 0.312512 Aug 24 17:49:47.077984 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 54/104] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:46 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1332 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:47.077984 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d4f71b47-e5c2-4723-9ca1-672da4642dce tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:47.077984 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d4f71b47-e5c2-4723-9ca1-672da4642dce tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:47.085638 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d4f71b47-e5c2-4723-9ca1-672da4642dce tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:47.086386 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d4f71b47-e5c2-4723-9ca1-672da4642dce tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:47.086964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d4f71b47-e5c2-4723-9ca1-672da4642dce tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:47.087959 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d4f71b47-e5c2-4723-9ca1-672da4642dce tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:47.089188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d4f71b47-e5c2-4723-9ca1-672da4642dce tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:47.089618 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d4f71b47-e5c2-4723-9ca1-672da4642dce tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:47.121012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f9f7f805-7448-4ece-bd76-b7f9ce804530 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:47.130559 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f9f7f805-7448-4ece-bd76-b7f9ce804530 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.373605 Aug 24 17:49:47.131205 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 51/105] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:46 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:47.255782 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d4f71b47-e5c2-4723-9ca1-672da4642dce tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:47.264278 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d4f71b47-e5c2-4723-9ca1-672da4642dce tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1365 microversion: 2.1 time: 0.190554 Aug 24 17:49:47.264856 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 55/106] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:47 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:47.590141 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-c1d13124-b98f-4502-a33e-fb636c62e2bc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:47.590868 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-c1d13124-b98f-4502-a33e-fb636c62e2bc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:47.598138 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c1d13124-b98f-4502-a33e-fb636c62e2bc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:47.598644 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c1d13124-b98f-4502-a33e-fb636c62e2bc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:47.599081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c1d13124-b98f-4502-a33e-fb636c62e2bc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:47.599795 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c1d13124-b98f-4502-a33e-fb636c62e2bc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:47.600255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c1d13124-b98f-4502-a33e-fb636c62e2bc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:47.600679 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c1d13124-b98f-4502-a33e-fb636c62e2bc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:47.666403 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c1d13124-b98f-4502-a33e-fb636c62e2bc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:47.675792 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-c1d13124-b98f-4502-a33e-fb636c62e2bc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1289 microversion: 2.1 time: 0.090396 Aug 24 17:49:47.676473 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 52/107] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:47 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:48.096245 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a57e0f58-7382-4a55-8f60-f7a19d891bf7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:48.096963 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a57e0f58-7382-4a55-8f60-f7a19d891bf7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:48.103431 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a57e0f58-7382-4a55-8f60-f7a19d891bf7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:48.103927 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a57e0f58-7382-4a55-8f60-f7a19d891bf7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:48.104377 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a57e0f58-7382-4a55-8f60-f7a19d891bf7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:48.105094 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a57e0f58-7382-4a55-8f60-f7a19d891bf7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:48.105553 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a57e0f58-7382-4a55-8f60-f7a19d891bf7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:48.106070 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a57e0f58-7382-4a55-8f60-f7a19d891bf7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:48.154613 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-2f8b71c9-c6d6-4020-a265-9ef3cb5c4f9b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:48.155932 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-2f8b71c9-c6d6-4020-a265-9ef3cb5c4f9b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:48.163594 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2f8b71c9-c6d6-4020-a265-9ef3cb5c4f9b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:48.165549 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2f8b71c9-c6d6-4020-a265-9ef3cb5c4f9b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:48.165549 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2f8b71c9-c6d6-4020-a265-9ef3cb5c4f9b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:48.165990 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2f8b71c9-c6d6-4020-a265-9ef3cb5c4f9b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:48.166444 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2f8b71c9-c6d6-4020-a265-9ef3cb5c4f9b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:48.166872 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2f8b71c9-c6d6-4020-a265-9ef3cb5c4f9b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:48.183583 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a57e0f58-7382-4a55-8f60-f7a19d891bf7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:48.196190 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a57e0f58-7382-4a55-8f60-f7a19d891bf7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:48.197900 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a57e0f58-7382-4a55-8f60-f7a19d891bf7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:48.199398 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a57e0f58-7382-4a55-8f60-f7a19d891bf7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1332 microversion: 2.20 time: 0.107248 Aug 24 17:49:48.200158 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 56/108] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:48 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:48.287080 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-68645e26-1c81-4bac-980e-fdab6e9a75d4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:48.287659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-68645e26-1c81-4bac-980e-fdab6e9a75d4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:48.294659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68645e26-1c81-4bac-980e-fdab6e9a75d4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:48.295305 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68645e26-1c81-4bac-980e-fdab6e9a75d4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:48.295887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68645e26-1c81-4bac-980e-fdab6e9a75d4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:48.296769 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68645e26-1c81-4bac-980e-fdab6e9a75d4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:48.297362 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68645e26-1c81-4bac-980e-fdab6e9a75d4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:48.297947 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68645e26-1c81-4bac-980e-fdab6e9a75d4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:48.321982 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-2f8b71c9-c6d6-4020-a265-9ef3cb5c4f9b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:48.331268 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-2f8b71c9-c6d6-4020-a265-9ef3cb5c4f9b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.180894 Aug 24 17:49:48.344511 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 53/109] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:48 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:48.451015 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-68645e26-1c81-4bac-980e-fdab6e9a75d4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:48.459161 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-68645e26-1c81-4bac-980e-fdab6e9a75d4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1365 microversion: 2.1 time: 0.176517 Aug 24 17:49:48.459748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 57/110] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:48 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:48.696674 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-514c03c1-3119-49ad-a81d-00fb71b03249 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:48.697287 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-514c03c1-3119-49ad-a81d-00fb71b03249 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:48.703246 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-514c03c1-3119-49ad-a81d-00fb71b03249 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:48.703724 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-514c03c1-3119-49ad-a81d-00fb71b03249 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:48.704158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-514c03c1-3119-49ad-a81d-00fb71b03249 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:48.705373 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-514c03c1-3119-49ad-a81d-00fb71b03249 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:48.705373 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-514c03c1-3119-49ad-a81d-00fb71b03249 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:48.706326 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-514c03c1-3119-49ad-a81d-00fb71b03249 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:48.793719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-514c03c1-3119-49ad-a81d-00fb71b03249 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:48.805498 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-514c03c1-3119-49ad-a81d-00fb71b03249 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1289 microversion: 2.1 time: 0.112614 Aug 24 17:49:48.806338 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 54/111] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:48 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1289 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:49.225911 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3df37131-be6d-45a3-a20a-0f860413caca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:49.228561 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3df37131-be6d-45a3-a20a-0f860413caca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:49.237248 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3df37131-be6d-45a3-a20a-0f860413caca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:49.239265 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3df37131-be6d-45a3-a20a-0f860413caca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:49.239963 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3df37131-be6d-45a3-a20a-0f860413caca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:49.240708 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3df37131-be6d-45a3-a20a-0f860413caca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:49.241252 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3df37131-be6d-45a3-a20a-0f860413caca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:49.241766 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3df37131-be6d-45a3-a20a-0f860413caca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:49.352515 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b10598ff-0f41-41b1-8a6a-7e0f8d324f62 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:49.353179 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-b10598ff-0f41-41b1-8a6a-7e0f8d324f62 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:49.358955 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3df37131-be6d-45a3-a20a-0f860413caca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:49.359161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b10598ff-0f41-41b1-8a6a-7e0f8d324f62 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:49.359533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b10598ff-0f41-41b1-8a6a-7e0f8d324f62 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:49.359963 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b10598ff-0f41-41b1-8a6a-7e0f8d324f62 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:49.361285 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b10598ff-0f41-41b1-8a6a-7e0f8d324f62 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:49.361774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b10598ff-0f41-41b1-8a6a-7e0f8d324f62 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:49.362866 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b10598ff-0f41-41b1-8a6a-7e0f8d324f62 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:49.368612 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3df37131-be6d-45a3-a20a-0f860413caca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:49.370620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3df37131-be6d-45a3-a20a-0f860413caca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:49.372672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3df37131-be6d-45a3-a20a-0f860413caca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1350 microversion: 2.20 time: 0.154005 Aug 24 17:49:49.375035 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 58/112] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:49 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1350 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:49.480863 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d4535771-fc0a-48ce-9daf-9bc8741bc07a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:49.481485 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d4535771-fc0a-48ce-9daf-9bc8741bc07a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:49.487809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d4535771-fc0a-48ce-9daf-9bc8741bc07a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:49.488528 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d4535771-fc0a-48ce-9daf-9bc8741bc07a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:49.488968 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d4535771-fc0a-48ce-9daf-9bc8741bc07a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:49.489674 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d4535771-fc0a-48ce-9daf-9bc8741bc07a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:49.490271 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d4535771-fc0a-48ce-9daf-9bc8741bc07a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:49.490585 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d4535771-fc0a-48ce-9daf-9bc8741bc07a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:49.608421 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b10598ff-0f41-41b1-8a6a-7e0f8d324f62 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:49.621908 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b10598ff-0f41-41b1-8a6a-7e0f8d324f62 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.273174 Aug 24 17:49:49.622247 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 55/113] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:49 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:49.793070 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-c7a2f620-ef10-40ad-b1ed-34e20b1b88aa req-9d7e75d9-04a3-4cab-a33e-d050b6b42ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd743b2-3b6c-4213-819a-1a25314ed5e2", "tag": "c21554ce-e587-47c2-9a5e-61d889373e08"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:49.817398 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-c7a2f620-ef10-40ad-b1ed-34e20b1b88aa req-9d7e75d9-04a3-4cab-a33e-d050b6b42ea2 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:49.817398 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-c7a2f620-ef10-40ad-b1ed-34e20b1b88aa req-9d7e75d9-04a3-4cab-a33e-d050b6b42ea2 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:49.817398 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-c7a2f620-ef10-40ad-b1ed-34e20b1b88aa req-9d7e75d9-04a3-4cab-a33e-d050b6b42ea2 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:49.861872 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-c7a2f620-ef10-40ad-b1ed-34e20b1b88aa req-9d7e75d9-04a3-4cab-a33e-d050b6b42ea2 service nova] Creating event network-changed:c21554ce-e587-47c2-9a5e-61d889373e08 for instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 on hv-cinder-85442 Aug 24 17:49:49.862081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-c7a2f620-ef10-40ad-b1ed-34e20b1b88aa req-9d7e75d9-04a3-4cab-a33e-d050b6b42ea2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127676) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 17:49:49.862465 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-c7a2f620-ef10-40ad-b1ed-34e20b1b88aa req-9d7e75d9-04a3-4cab-a33e-d050b6b42ea2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127676) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 17:49:49.863488 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fd4b709c-d75f-4fdd-86c2-900fc859c83b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:49.863940 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fd4b709c-d75f-4fdd-86c2-900fc859c83b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:49.864437 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fd4b709c-d75f-4fdd-86c2-900fc859c83b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:49.865181 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fd4b709c-d75f-4fdd-86c2-900fc859c83b None None] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:49.865622 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fd4b709c-d75f-4fdd-86c2-900fc859c83b None None] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:49.866151 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fd4b709c-d75f-4fdd-86c2-900fc859c83b None None] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:49.886138 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.compute.rpcapi [None req-fd4b709c-d75f-4fdd-86c2-900fc859c83b None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 17:49:49.887099 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fd4b709c-d75f-4fdd-86c2-900fc859c83b None None] Releasing lock "compute-rpcapi-router" {{(pid=127676) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 17:49:49.914347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-fd4b709c-d75f-4fdd-86c2-900fc859c83b None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126210 Aug 24 17:49:49.916728 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 56/114] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:49:49.925191 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a706e2b9-34ba-4443-a62e-08d7ba853526 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:49.925941 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a706e2b9-34ba-4443-a62e-08d7ba853526 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:49.932516 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a706e2b9-34ba-4443-a62e-08d7ba853526 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:49.933011 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a706e2b9-34ba-4443-a62e-08d7ba853526 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:49.933451 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a706e2b9-34ba-4443-a62e-08d7ba853526 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:49.934200 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a706e2b9-34ba-4443-a62e-08d7ba853526 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:49.934660 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a706e2b9-34ba-4443-a62e-08d7ba853526 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:49.935093 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a706e2b9-34ba-4443-a62e-08d7ba853526 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:49.971463 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d4535771-fc0a-48ce-9daf-9bc8741bc07a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:49.984835 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d4535771-fc0a-48ce-9daf-9bc8741bc07a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1365 microversion: 2.1 time: 0.507663 Aug 24 17:49:49.985389 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 59/115] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:49 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1365 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:50.022007 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a706e2b9-34ba-4443-a62e-08d7ba853526 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:50.029951 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a706e2b9-34ba-4443-a62e-08d7ba853526 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1297 microversion: 2.1 time: 0.110851 Aug 24 17:49:50.031350 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 57/116] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:49 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1297 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:50.399424 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-bd103d06-6ada-4171-b7b2-784433d49c68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:50.400635 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-bd103d06-6ada-4171-b7b2-784433d49c68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:50.411156 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bd103d06-6ada-4171-b7b2-784433d49c68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:50.411899 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bd103d06-6ada-4171-b7b2-784433d49c68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:50.414674 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bd103d06-6ada-4171-b7b2-784433d49c68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:50.430564 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bd103d06-6ada-4171-b7b2-784433d49c68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:50.437776 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bd103d06-6ada-4171-b7b2-784433d49c68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:50.442179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bd103d06-6ada-4171-b7b2-784433d49c68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:50.664960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-bd103d06-6ada-4171-b7b2-784433d49c68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:50.664960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=100 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:50.664960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-bd103d06-6ada-4171-b7b2-784433d49c68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:50.665426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-566aadcb-9e9c-4999-a1e0-73001cd05d44 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:50.665943 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-bd103d06-6ada-4171-b7b2-784433d49c68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:50.666046 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-566aadcb-9e9c-4999-a1e0-73001cd05d44 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:50.666132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-bd103d06-6ada-4171-b7b2-784433d49c68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1405 microversion: 2.20 time: 0.260079 Aug 24 17:49:50.666132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 60/117] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:50 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1405 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:50.666317 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-566aadcb-9e9c-4999-a1e0-73001cd05d44 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:50.666317 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-566aadcb-9e9c-4999-a1e0-73001cd05d44 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:50.666317 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-566aadcb-9e9c-4999-a1e0-73001cd05d44 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:50.667657 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-566aadcb-9e9c-4999-a1e0-73001cd05d44 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:50.668276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-566aadcb-9e9c-4999-a1e0-73001cd05d44 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:50.668850 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-566aadcb-9e9c-4999-a1e0-73001cd05d44 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:50.823849 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-566aadcb-9e9c-4999-a1e0-73001cd05d44 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:50.833299 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-566aadcb-9e9c-4999-a1e0-73001cd05d44 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.187942 Aug 24 17:49:50.833902 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 58/118] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:50 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:51.005937 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c7a31ff8-788b-44f3-99c8-c0fdba573999 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:51.006549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c7a31ff8-788b-44f3-99c8-c0fdba573999 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:51.023702 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c7a31ff8-788b-44f3-99c8-c0fdba573999 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:51.024479 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c7a31ff8-788b-44f3-99c8-c0fdba573999 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:51.024950 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c7a31ff8-788b-44f3-99c8-c0fdba573999 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:51.025661 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c7a31ff8-788b-44f3-99c8-c0fdba573999 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:51.026129 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c7a31ff8-788b-44f3-99c8-c0fdba573999 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:51.026887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c7a31ff8-788b-44f3-99c8-c0fdba573999 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:51.058361 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f1f8ac91-e0a4-40cf-b955-1689461496fa tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:51.061473 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f1f8ac91-e0a4-40cf-b955-1689461496fa tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:51.074280 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f1f8ac91-e0a4-40cf-b955-1689461496fa tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:51.074791 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f1f8ac91-e0a4-40cf-b955-1689461496fa tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:51.075270 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f1f8ac91-e0a4-40cf-b955-1689461496fa tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:51.075978 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f1f8ac91-e0a4-40cf-b955-1689461496fa tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:51.076809 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f1f8ac91-e0a4-40cf-b955-1689461496fa tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:51.078360 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f1f8ac91-e0a4-40cf-b955-1689461496fa tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:51.288685 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f1f8ac91-e0a4-40cf-b955-1689461496fa tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:51.304707 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f1f8ac91-e0a4-40cf-b955-1689461496fa tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1307 microversion: 2.1 time: 0.252392 Aug 24 17:49:51.306906 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 59/119] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:51 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1307 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:51.595336 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c7a31ff8-788b-44f3-99c8-c0fdba573999 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:51.605706 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c7a31ff8-788b-44f3-99c8-c0fdba573999 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1365 microversion: 2.1 time: 0.603920 Aug 24 17:49:51.611832 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 61/120] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:51 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1365 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:51.684707 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-1581ae24-0f38-49fe-8c0d-48add1d15744 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:51.685343 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-1581ae24-0f38-49fe-8c0d-48add1d15744 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:51.698013 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1581ae24-0f38-49fe-8c0d-48add1d15744 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:51.698013 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1581ae24-0f38-49fe-8c0d-48add1d15744 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:51.700314 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1581ae24-0f38-49fe-8c0d-48add1d15744 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:51.701151 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1581ae24-0f38-49fe-8c0d-48add1d15744 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:51.701625 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1581ae24-0f38-49fe-8c0d-48add1d15744 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:51.703871 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1581ae24-0f38-49fe-8c0d-48add1d15744 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:51.854891 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3019b74b-c682-4d56-b4c5-9832b2f092a6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:51.855496 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3019b74b-c682-4d56-b4c5-9832b2f092a6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:51.869873 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3019b74b-c682-4d56-b4c5-9832b2f092a6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:51.870417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3019b74b-c682-4d56-b4c5-9832b2f092a6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:51.870850 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3019b74b-c682-4d56-b4c5-9832b2f092a6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:51.871554 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3019b74b-c682-4d56-b4c5-9832b2f092a6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:51.871998 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3019b74b-c682-4d56-b4c5-9832b2f092a6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:51.872416 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3019b74b-c682-4d56-b4c5-9832b2f092a6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:51.934353 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-1581ae24-0f38-49fe-8c0d-48add1d15744 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:51.938318 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=100 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:51.954791 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-1581ae24-0f38-49fe-8c0d-48add1d15744 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:51.957309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-1581ae24-0f38-49fe-8c0d-48add1d15744 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:51.958371 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-1581ae24-0f38-49fe-8c0d-48add1d15744 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1405 microversion: 2.20 time: 0.285285 Aug 24 17:49:51.970731 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 60/121] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:51 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1405 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:52.157009 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3019b74b-c682-4d56-b4c5-9832b2f092a6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:52.172961 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3019b74b-c682-4d56-b4c5-9832b2f092a6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.321919 Aug 24 17:49:52.187255 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 62/122] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:51 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:52.334393 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-548d9c8e-d0b1-48bb-961d-91a378db6b83 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:52.335194 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-548d9c8e-d0b1-48bb-961d-91a378db6b83 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:52.347954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-548d9c8e-d0b1-48bb-961d-91a378db6b83 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:52.348441 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-548d9c8e-d0b1-48bb-961d-91a378db6b83 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:52.349344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-548d9c8e-d0b1-48bb-961d-91a378db6b83 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:52.350748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-548d9c8e-d0b1-48bb-961d-91a378db6b83 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:52.351434 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-548d9c8e-d0b1-48bb-961d-91a378db6b83 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:52.352088 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-548d9c8e-d0b1-48bb-961d-91a378db6b83 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:52.475944 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-548d9c8e-d0b1-48bb-961d-91a378db6b83 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:52.484162 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-548d9c8e-d0b1-48bb-961d-91a378db6b83 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1295 microversion: 2.1 time: 0.157300 Aug 24 17:49:52.494317 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 61/123] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:52 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1295 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:52.631424 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3b43fcaa-c4c0-4918-8062-bac1f0c34c35 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:52.632669 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3b43fcaa-c4c0-4918-8062-bac1f0c34c35 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:52.648385 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3b43fcaa-c4c0-4918-8062-bac1f0c34c35 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:52.648874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3b43fcaa-c4c0-4918-8062-bac1f0c34c35 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:52.649311 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3b43fcaa-c4c0-4918-8062-bac1f0c34c35 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:52.651857 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3b43fcaa-c4c0-4918-8062-bac1f0c34c35 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:52.653220 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3b43fcaa-c4c0-4918-8062-bac1f0c34c35 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:52.654659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3b43fcaa-c4c0-4918-8062-bac1f0c34c35 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:52.843235 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-3bff1d74-42de-494e-a80d-9ef17e0d6e31 req-81926c7b-8e84-43a2-9eae-f51fe567456b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "154f9aac-b081-4041-ba41-dd14fb267e29", "tag": "12033839-1050-4fb0-90d7-ede010ae619a"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:52.869462 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-3bff1d74-42de-494e-a80d-9ef17e0d6e31 req-81926c7b-8e84-43a2-9eae-f51fe567456b service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:52.870182 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-3bff1d74-42de-494e-a80d-9ef17e0d6e31 req-81926c7b-8e84-43a2-9eae-f51fe567456b service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:52.871311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-3bff1d74-42de-494e-a80d-9ef17e0d6e31 req-81926c7b-8e84-43a2-9eae-f51fe567456b service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:52.888327 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3b43fcaa-c4c0-4918-8062-bac1f0c34c35 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:52.892690 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-3bff1d74-42de-494e-a80d-9ef17e0d6e31 req-81926c7b-8e84-43a2-9eae-f51fe567456b service nova] Creating event network-changed:12033839-1050-4fb0-90d7-ede010ae619a for instance 154f9aac-b081-4041-ba41-dd14fb267e29 on hv-cinder-85442 Aug 24 17:49:52.897764 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3b43fcaa-c4c0-4918-8062-bac1f0c34c35 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1365 microversion: 2.1 time: 0.274120 Aug 24 17:49:52.898852 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 63/124] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:52 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1365 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:52.914447 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-3bff1d74-42de-494e-a80d-9ef17e0d6e31 req-81926c7b-8e84-43a2-9eae-f51fe567456b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207019 Aug 24 17:49:52.915680 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 62/125] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:52.984847 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d839bb74-a89c-4385-8ed2-7dbca281fa62 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:52.986144 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d839bb74-a89c-4385-8ed2-7dbca281fa62 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:52.998586 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d839bb74-a89c-4385-8ed2-7dbca281fa62 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:52.998586 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d839bb74-a89c-4385-8ed2-7dbca281fa62 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:52.998586 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d839bb74-a89c-4385-8ed2-7dbca281fa62 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:52.998586 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d839bb74-a89c-4385-8ed2-7dbca281fa62 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:52.998999 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d839bb74-a89c-4385-8ed2-7dbca281fa62 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:52.998999 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d839bb74-a89c-4385-8ed2-7dbca281fa62 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:53.138824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d839bb74-a89c-4385-8ed2-7dbca281fa62 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:53.148101 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d839bb74-a89c-4385-8ed2-7dbca281fa62 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:53.149598 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d839bb74-a89c-4385-8ed2-7dbca281fa62 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:53.150737 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d839bb74-a89c-4385-8ed2-7dbca281fa62 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1405 microversion: 2.20 time: 0.169842 Aug 24 17:49:53.151351 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 64/126] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:52 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:53.195570 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-9292f0d1-bf59-4d45-94b0-ce4c47f8dcf2 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:53.196316 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-9292f0d1-bf59-4d45-94b0-ce4c47f8dcf2 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:53.202540 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9292f0d1-bf59-4d45-94b0-ce4c47f8dcf2 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:53.203025 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9292f0d1-bf59-4d45-94b0-ce4c47f8dcf2 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:53.203553 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9292f0d1-bf59-4d45-94b0-ce4c47f8dcf2 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:53.204752 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9292f0d1-bf59-4d45-94b0-ce4c47f8dcf2 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:53.205367 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9292f0d1-bf59-4d45-94b0-ce4c47f8dcf2 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:53.205795 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9292f0d1-bf59-4d45-94b0-ce4c47f8dcf2 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:53.346025 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-9292f0d1-bf59-4d45-94b0-ce4c47f8dcf2 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:53.354305 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-9292f0d1-bf59-4d45-94b0-ce4c47f8dcf2 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.162981 Aug 24 17:49:53.354939 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 63/127] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:53 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:53.506880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-5c244cde-9af5-47ac-bebe-61ef97c6e831 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:53.507493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-5c244cde-9af5-47ac-bebe-61ef97c6e831 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:53.513759 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5c244cde-9af5-47ac-bebe-61ef97c6e831 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:53.514270 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5c244cde-9af5-47ac-bebe-61ef97c6e831 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:53.514702 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5c244cde-9af5-47ac-bebe-61ef97c6e831 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:53.515397 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5c244cde-9af5-47ac-bebe-61ef97c6e831 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:53.515851 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5c244cde-9af5-47ac-bebe-61ef97c6e831 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:53.516270 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5c244cde-9af5-47ac-bebe-61ef97c6e831 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:53.654816 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5c244cde-9af5-47ac-bebe-61ef97c6e831 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:53.663080 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-5c244cde-9af5-47ac-bebe-61ef97c6e831 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1361 microversion: 2.1 time: 0.161829 Aug 24 17:49:53.663644 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 65/128] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:53 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:53.920135 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-52f5e16d-8234-4460-8281-8b2033b8da7e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:53.920779 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-52f5e16d-8234-4460-8281-8b2033b8da7e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:53.927070 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-52f5e16d-8234-4460-8281-8b2033b8da7e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:53.927558 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-52f5e16d-8234-4460-8281-8b2033b8da7e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:53.928027 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-52f5e16d-8234-4460-8281-8b2033b8da7e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:53.928749 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-52f5e16d-8234-4460-8281-8b2033b8da7e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:53.929207 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-52f5e16d-8234-4460-8281-8b2033b8da7e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:53.929626 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-52f5e16d-8234-4460-8281-8b2033b8da7e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:54.068271 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-52f5e16d-8234-4460-8281-8b2033b8da7e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:54.076219 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-52f5e16d-8234-4460-8281-8b2033b8da7e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1365 microversion: 2.1 time: 0.159870 Aug 24 17:49:54.076796 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 64/129] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:53 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:54.174499 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a3125b49-d165-4b24-a714-8ceac5eef1ee tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:54.175107 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a3125b49-d165-4b24-a714-8ceac5eef1ee tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:54.181125 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a3125b49-d165-4b24-a714-8ceac5eef1ee tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:54.181610 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a3125b49-d165-4b24-a714-8ceac5eef1ee tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:54.182084 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a3125b49-d165-4b24-a714-8ceac5eef1ee tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:54.182769 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a3125b49-d165-4b24-a714-8ceac5eef1ee tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:54.183231 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a3125b49-d165-4b24-a714-8ceac5eef1ee tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:54.183656 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a3125b49-d165-4b24-a714-8ceac5eef1ee tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:54.317920 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a3125b49-d165-4b24-a714-8ceac5eef1ee tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:54.326251 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a3125b49-d165-4b24-a714-8ceac5eef1ee tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:54.327734 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a3125b49-d165-4b24-a714-8ceac5eef1ee tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:54.328833 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a3125b49-d165-4b24-a714-8ceac5eef1ee tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1405 microversion: 2.20 time: 0.158347 Aug 24 17:49:54.330254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 66/130] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:54 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:54.375111 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-1a7ebb64-d8a8-4186-822a-fc627600928a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:54.375746 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-1a7ebb64-d8a8-4186-822a-fc627600928a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:54.382654 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1a7ebb64-d8a8-4186-822a-fc627600928a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:54.383133 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1a7ebb64-d8a8-4186-822a-fc627600928a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:54.383567 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1a7ebb64-d8a8-4186-822a-fc627600928a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:54.384245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1a7ebb64-d8a8-4186-822a-fc627600928a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:54.384696 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1a7ebb64-d8a8-4186-822a-fc627600928a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:54.385114 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1a7ebb64-d8a8-4186-822a-fc627600928a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:54.527055 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-1a7ebb64-d8a8-4186-822a-fc627600928a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:54.535826 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-1a7ebb64-d8a8-4186-822a-fc627600928a tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.164531 Aug 24 17:49:54.536401 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 65/131] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:54 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:54.685306 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-63271118-0666-43c2-9b76-7244ac98d4fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:54.686134 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-63271118-0666-43c2-9b76-7244ac98d4fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:54.692891 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-63271118-0666-43c2-9b76-7244ac98d4fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:54.693378 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-63271118-0666-43c2-9b76-7244ac98d4fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:54.693811 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-63271118-0666-43c2-9b76-7244ac98d4fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:54.694551 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-63271118-0666-43c2-9b76-7244ac98d4fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:54.695008 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-63271118-0666-43c2-9b76-7244ac98d4fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:54.695426 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-63271118-0666-43c2-9b76-7244ac98d4fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:54.831064 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-63271118-0666-43c2-9b76-7244ac98d4fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:54.838871 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-63271118-0666-43c2-9b76-7244ac98d4fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1361 microversion: 2.1 time: 0.158878 Aug 24 17:49:54.839453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 67/132] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:54 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:55.097832 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-c7570696-cd3a-4048-a291-501bafba9808 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:55.098507 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-c7570696-cd3a-4048-a291-501bafba9808 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:55.105529 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c7570696-cd3a-4048-a291-501bafba9808 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:55.108522 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c7570696-cd3a-4048-a291-501bafba9808 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:55.108989 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c7570696-cd3a-4048-a291-501bafba9808 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:55.109732 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c7570696-cd3a-4048-a291-501bafba9808 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:55.110313 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c7570696-cd3a-4048-a291-501bafba9808 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:55.110946 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c7570696-cd3a-4048-a291-501bafba9808 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:55.355318 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-34c457fa-3c4b-4b8e-ba26-718f1b85296d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:55.356390 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-34c457fa-3c4b-4b8e-ba26-718f1b85296d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:55.364151 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-34c457fa-3c4b-4b8e-ba26-718f1b85296d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:55.364676 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-34c457fa-3c4b-4b8e-ba26-718f1b85296d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:55.365089 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-34c457fa-3c4b-4b8e-ba26-718f1b85296d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:55.366171 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-34c457fa-3c4b-4b8e-ba26-718f1b85296d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:55.367963 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-34c457fa-3c4b-4b8e-ba26-718f1b85296d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:55.368819 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-34c457fa-3c4b-4b8e-ba26-718f1b85296d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:55.406108 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c7570696-cd3a-4048-a291-501bafba9808 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:55.443017 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-c7570696-cd3a-4048-a291-501bafba9808 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1365 microversion: 2.1 time: 0.347196 Aug 24 17:49:55.443017 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 66/133] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:55 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1365 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:55.557904 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e5903fa5-efed-4581-a884-4b1bb0ebd05c tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:55.558588 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e5903fa5-efed-4581-a884-4b1bb0ebd05c tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:55.569677 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e5903fa5-efed-4581-a884-4b1bb0ebd05c tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:55.570445 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e5903fa5-efed-4581-a884-4b1bb0ebd05c tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:55.571121 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e5903fa5-efed-4581-a884-4b1bb0ebd05c tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:55.572061 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e5903fa5-efed-4581-a884-4b1bb0ebd05c tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:55.572910 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e5903fa5-efed-4581-a884-4b1bb0ebd05c tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:55.573741 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e5903fa5-efed-4581-a884-4b1bb0ebd05c tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:55.833844 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-34c457fa-3c4b-4b8e-ba26-718f1b85296d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:55.847321 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-34c457fa-3c4b-4b8e-ba26-718f1b85296d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:55.849969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-34c457fa-3c4b-4b8e-ba26-718f1b85296d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:55.965198 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-34c457fa-3c4b-4b8e-ba26-718f1b85296d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1405 microversion: 2.20 time: 0.502820 Aug 24 17:49:55.965198 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 68/134] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:55 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1405 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:55.965198 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3536ed8b-ce1a-47eb-b326-ffecb0207a3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:55.965198 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3536ed8b-ce1a-47eb-b326-ffecb0207a3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:55.965198 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3536ed8b-ce1a-47eb-b326-ffecb0207a3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:55.966162 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3536ed8b-ce1a-47eb-b326-ffecb0207a3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:55.966162 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3536ed8b-ce1a-47eb-b326-ffecb0207a3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:55.966387 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e5903fa5-efed-4581-a884-4b1bb0ebd05c tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:55.966949 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3536ed8b-ce1a-47eb-b326-ffecb0207a3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:55.966949 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3536ed8b-ce1a-47eb-b326-ffecb0207a3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:55.966949 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3536ed8b-ce1a-47eb-b326-ffecb0207a3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:55.967224 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e5903fa5-efed-4581-a884-4b1bb0ebd05c tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.334062 Aug 24 17:49:55.967224 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 67/135] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:55 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:56.045711 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3536ed8b-ce1a-47eb-b326-ffecb0207a3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:56.055630 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3536ed8b-ce1a-47eb-b326-ffecb0207a3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1361 microversion: 2.1 time: 0.198896 Aug 24 17:49:56.056320 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 69/136] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:55 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:56.524721 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-eb392272-d663-4c71-a30a-0a4a720baf8b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:56.524721 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-eb392272-d663-4c71-a30a-0a4a720baf8b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:56.524721 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-eb392272-d663-4c71-a30a-0a4a720baf8b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:56.524721 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-eb392272-d663-4c71-a30a-0a4a720baf8b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:56.525665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-eb392272-d663-4c71-a30a-0a4a720baf8b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:56.525665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-eb392272-d663-4c71-a30a-0a4a720baf8b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:56.525665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-eb392272-d663-4c71-a30a-0a4a720baf8b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:56.525665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-eb392272-d663-4c71-a30a-0a4a720baf8b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:56.963886 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-eb392272-d663-4c71-a30a-0a4a720baf8b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:56.974292 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-eb392272-d663-4c71-a30a-0a4a720baf8b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1365 microversion: 2.1 time: 0.513408 Aug 24 17:49:56.975046 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 68/137] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:56 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1365 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:56.999025 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0aa6a057-fbc4-4df1-9a4e-4b5b3fbe1764 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:56.999567 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0aa6a057-fbc4-4df1-9a4e-4b5b3fbe1764 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:57.006726 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0aa6a057-fbc4-4df1-9a4e-4b5b3fbe1764 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:57.007484 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0aa6a057-fbc4-4df1-9a4e-4b5b3fbe1764 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:57.008127 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0aa6a057-fbc4-4df1-9a4e-4b5b3fbe1764 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:57.009025 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0aa6a057-fbc4-4df1-9a4e-4b5b3fbe1764 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:57.009672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0aa6a057-fbc4-4df1-9a4e-4b5b3fbe1764 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:57.010113 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0aa6a057-fbc4-4df1-9a4e-4b5b3fbe1764 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:57.010235 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-9cb7731c-be05-433d-b285-7cfeab6f7ff5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:57.010746 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-9cb7731c-be05-433d-b285-7cfeab6f7ff5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:57.017416 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9cb7731c-be05-433d-b285-7cfeab6f7ff5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:57.018335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9cb7731c-be05-433d-b285-7cfeab6f7ff5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:57.018556 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9cb7731c-be05-433d-b285-7cfeab6f7ff5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:57.019212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9cb7731c-be05-433d-b285-7cfeab6f7ff5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:57.019656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9cb7731c-be05-433d-b285-7cfeab6f7ff5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:57.020070 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9cb7731c-be05-433d-b285-7cfeab6f7ff5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:57.283964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0aa6a057-fbc4-4df1-9a4e-4b5b3fbe1764 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:57.287098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-9cb7731c-be05-433d-b285-7cfeab6f7ff5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:57.296915 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-9cb7731c-be05-433d-b285-7cfeab6f7ff5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:57.298424 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0aa6a057-fbc4-4df1-9a4e-4b5b3fbe1764 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.312356 Aug 24 17:49:57.299382 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 70/138] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:56 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:57.299507 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-9cb7731c-be05-433d-b285-7cfeab6f7ff5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:57.300774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-9cb7731c-be05-433d-b285-7cfeab6f7ff5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1405 microversion: 2.20 time: 0.296520 Aug 24 17:49:57.301632 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 69/139] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:57 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1405 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:57.303856 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-68b2a4ff-54d8-469b-8a1e-c2146a5c3911 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:57.304451 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-68b2a4ff-54d8-469b-8a1e-c2146a5c3911 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:57.310325 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68b2a4ff-54d8-469b-8a1e-c2146a5c3911 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:57.310799 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68b2a4ff-54d8-469b-8a1e-c2146a5c3911 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:57.311226 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68b2a4ff-54d8-469b-8a1e-c2146a5c3911 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:57.311901 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68b2a4ff-54d8-469b-8a1e-c2146a5c3911 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:57.312347 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68b2a4ff-54d8-469b-8a1e-c2146a5c3911 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:57.318590 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68b2a4ff-54d8-469b-8a1e-c2146a5c3911 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:57.478584 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-d71ca5c3-e822-44b8-a327-0190486ce7ee req-d2525c2a-8383-48f8-b3f8-62b866349664 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec9a988c-b152-4e39-ad48-c2f7facd203f", "tag": "d93fe402-2e98-4ff9-8441-854219d9e667"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:57.488561 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-68b2a4ff-54d8-469b-8a1e-c2146a5c3911 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:57.514955 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-d71ca5c3-e822-44b8-a327-0190486ce7ee req-d2525c2a-8383-48f8-b3f8-62b866349664 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:57.517672 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-d71ca5c3-e822-44b8-a327-0190486ce7ee req-d2525c2a-8383-48f8-b3f8-62b866349664 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:57.519796 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-68b2a4ff-54d8-469b-8a1e-c2146a5c3911 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1361 microversion: 2.1 time: 0.219379 Aug 24 17:49:57.520905 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-d71ca5c3-e822-44b8-a327-0190486ce7ee req-d2525c2a-8383-48f8-b3f8-62b866349664 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:57.528034 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 71/140] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:57 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:57.551787 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-d71ca5c3-e822-44b8-a327-0190486ce7ee req-d2525c2a-8383-48f8-b3f8-62b866349664 service nova] Creating event network-changed:d93fe402-2e98-4ff9-8441-854219d9e667 for instance ec9a988c-b152-4e39-ad48-c2f7facd203f on hv-cinder-85442 Aug 24 17:49:57.557978 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-d71ca5c3-e822-44b8-a327-0190486ce7ee req-d2525c2a-8383-48f8-b3f8-62b866349664 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085727 Aug 24 17:49:57.558648 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 70/141] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:57.814280 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-5913752b-cb0d-484a-b5e3-85923b6fb9d2 req-ace59f38-9049-4a18-bd4a-6851fbf10893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cdde8bf-31af-4304-8f4e-025156ca51db", "name": "network-vif-plugged", "status": "completed", "tag": "50953070-74ca-4fab-9f1c-1e78ed898180"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:57.829561 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-5913752b-cb0d-484a-b5e3-85923b6fb9d2 req-ace59f38-9049-4a18-bd4a-6851fbf10893 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:57.830085 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-5913752b-cb0d-484a-b5e3-85923b6fb9d2 req-ace59f38-9049-4a18-bd4a-6851fbf10893 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:57.830516 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-5913752b-cb0d-484a-b5e3-85923b6fb9d2 req-ace59f38-9049-4a18-bd4a-6851fbf10893 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:57.843111 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-5913752b-cb0d-484a-b5e3-85923b6fb9d2 req-ace59f38-9049-4a18-bd4a-6851fbf10893 service nova] Creating event network-vif-plugged:50953070-74ca-4fab-9f1c-1e78ed898180 for instance 4cdde8bf-31af-4304-8f4e-025156ca51db on hv-cinder-85442 Aug 24 17:49:57.848976 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-5913752b-cb0d-484a-b5e3-85923b6fb9d2 req-ace59f38-9049-4a18-bd4a-6851fbf10893 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107572 Aug 24 17:49:57.849586 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 72/142] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:57.997435 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8dd39992-3400-449b-83be-12a71b615b5d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:57.998348 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8dd39992-3400-449b-83be-12a71b615b5d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:58.005786 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8dd39992-3400-449b-83be-12a71b615b5d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:58.006438 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8dd39992-3400-449b-83be-12a71b615b5d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:58.007087 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8dd39992-3400-449b-83be-12a71b615b5d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:58.007942 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8dd39992-3400-449b-83be-12a71b615b5d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:58.008574 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8dd39992-3400-449b-83be-12a71b615b5d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:58.009120 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8dd39992-3400-449b-83be-12a71b615b5d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:58.199564 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8dd39992-3400-449b-83be-12a71b615b5d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:58.207966 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-8dd39992-3400-449b-83be-12a71b615b5d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1365 microversion: 2.1 time: 0.214753 Aug 24 17:49:58.213434 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 71/143] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:57 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:58.322959 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-71cf8dc5-e15d-4e24-b554-6ad9ebc58776 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:58.325019 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-71cf8dc5-e15d-4e24-b554-6ad9ebc58776 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:58.325127 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-14e4caed-ed8c-4189-9cd9-07dda8b92d7e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:58.325127 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-14e4caed-ed8c-4189-9cd9-07dda8b92d7e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:58.335298 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-14e4caed-ed8c-4189-9cd9-07dda8b92d7e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:58.336222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-14e4caed-ed8c-4189-9cd9-07dda8b92d7e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:58.336439 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-71cf8dc5-e15d-4e24-b554-6ad9ebc58776 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:58.337080 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-14e4caed-ed8c-4189-9cd9-07dda8b92d7e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:58.338369 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-14e4caed-ed8c-4189-9cd9-07dda8b92d7e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:58.339266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-14e4caed-ed8c-4189-9cd9-07dda8b92d7e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:58.339462 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-71cf8dc5-e15d-4e24-b554-6ad9ebc58776 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:58.340046 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-14e4caed-ed8c-4189-9cd9-07dda8b92d7e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:58.344868 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-71cf8dc5-e15d-4e24-b554-6ad9ebc58776 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:58.345994 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-71cf8dc5-e15d-4e24-b554-6ad9ebc58776 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:58.346682 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-71cf8dc5-e15d-4e24-b554-6ad9ebc58776 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:58.347131 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-71cf8dc5-e15d-4e24-b554-6ad9ebc58776 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:58.582317 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-14e4caed-ed8c-4189-9cd9-07dda8b92d7e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:58.597844 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-14e4caed-ed8c-4189-9cd9-07dda8b92d7e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:58.600295 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-14e4caed-ed8c-4189-9cd9-07dda8b92d7e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:58.601894 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-14e4caed-ed8c-4189-9cd9-07dda8b92d7e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1405 microversion: 2.20 time: 0.281588 Aug 24 17:49:58.602621 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 72/144] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:58 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1405 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:58.623087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-71cf8dc5-e15d-4e24-b554-6ad9ebc58776 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:58.626678 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e5279dde-09e9-4985-bc4e-5b3c1f756c91 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:58.629369 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e5279dde-09e9-4985-bc4e-5b3c1f756c91 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:58.633632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-71cf8dc5-e15d-4e24-b554-6ad9ebc58776 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.315849 Aug 24 17:49:58.645884 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 73/145] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:58 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:58.655999 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e5279dde-09e9-4985-bc4e-5b3c1f756c91 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:58.656840 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e5279dde-09e9-4985-bc4e-5b3c1f756c91 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:58.658038 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e5279dde-09e9-4985-bc4e-5b3c1f756c91 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:58.658880 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e5279dde-09e9-4985-bc4e-5b3c1f756c91 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:58.659453 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e5279dde-09e9-4985-bc4e-5b3c1f756c91 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:58.659884 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e5279dde-09e9-4985-bc4e-5b3c1f756c91 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:58.976614 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e5279dde-09e9-4985-bc4e-5b3c1f756c91 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:58.987603 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e5279dde-09e9-4985-bc4e-5b3c1f756c91 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1361 microversion: 2.1 time: 0.383461 Aug 24 17:49:58.988542 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 73/146] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:58 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1361 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:59.232744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d2232e3b-f333-4c42-9adf-3309a6f02abf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:59.234446 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d2232e3b-f333-4c42-9adf-3309a6f02abf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:59.278147 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d2232e3b-f333-4c42-9adf-3309a6f02abf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:59.279058 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d2232e3b-f333-4c42-9adf-3309a6f02abf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:59.280907 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d2232e3b-f333-4c42-9adf-3309a6f02abf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:59.284902 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d2232e3b-f333-4c42-9adf-3309a6f02abf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:59.287379 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d2232e3b-f333-4c42-9adf-3309a6f02abf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:59.288879 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d2232e3b-f333-4c42-9adf-3309a6f02abf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:59.470874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d2232e3b-f333-4c42-9adf-3309a6f02abf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:59.486964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d2232e3b-f333-4c42-9adf-3309a6f02abf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1365 microversion: 2.1 time: 0.261887 Aug 24 17:49:59.487628 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 74/147] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:59 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:59.628177 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a7dc692d-576a-4407-90a0-362ce5ca807c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:59.628809 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a7dc692d-576a-4407-90a0-362ce5ca807c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:59.636673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a7dc692d-576a-4407-90a0-362ce5ca807c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:59.637161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a7dc692d-576a-4407-90a0-362ce5ca807c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:59.637591 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a7dc692d-576a-4407-90a0-362ce5ca807c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:59.638323 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a7dc692d-576a-4407-90a0-362ce5ca807c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:59.638794 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a7dc692d-576a-4407-90a0-362ce5ca807c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:59.639394 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a7dc692d-576a-4407-90a0-362ce5ca807c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:59.664461 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-66c3388a-025a-4570-9859-51af8a4a4729 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:59.665581 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-66c3388a-025a-4570-9859-51af8a4a4729 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:59.674478 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-66c3388a-025a-4570-9859-51af8a4a4729 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:59.675311 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-66c3388a-025a-4570-9859-51af8a4a4729 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:59.676614 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-66c3388a-025a-4570-9859-51af8a4a4729 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:59.677532 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-66c3388a-025a-4570-9859-51af8a4a4729 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:59.678094 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-66c3388a-025a-4570-9859-51af8a4a4729 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:59.678671 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-66c3388a-025a-4570-9859-51af8a4a4729 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:59.876662 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a7dc692d-576a-4407-90a0-362ce5ca807c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:59.883319 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=2 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:59.887058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a7dc692d-576a-4407-90a0-362ce5ca807c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:59.888549 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a7dc692d-576a-4407-90a0-362ce5ca807c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:59.889735 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a7dc692d-576a-4407-90a0-362ce5ca807c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1405 microversion: 2.20 time: 0.265954 Aug 24 17:49:59.890338 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 74/148] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:59 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:49:59.915888 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-66c3388a-025a-4570-9859-51af8a4a4729 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:59.925202 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-66c3388a-025a-4570-9859-51af8a4a4729 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.266429 Aug 24 17:49:59.947933 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 75/149] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:59 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:00.011996 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-475b21d0-2934-48f2-95a7-154c6bb5f3cf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:00.012697 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-475b21d0-2934-48f2-95a7-154c6bb5f3cf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:00.019581 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-475b21d0-2934-48f2-95a7-154c6bb5f3cf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:00.020061 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-475b21d0-2934-48f2-95a7-154c6bb5f3cf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:00.020491 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-475b21d0-2934-48f2-95a7-154c6bb5f3cf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:00.021174 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-475b21d0-2934-48f2-95a7-154c6bb5f3cf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:00.021623 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-475b21d0-2934-48f2-95a7-154c6bb5f3cf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:00.022140 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-475b21d0-2934-48f2-95a7-154c6bb5f3cf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:00.159448 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-475b21d0-2934-48f2-95a7-154c6bb5f3cf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:00.167767 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-475b21d0-2934-48f2-95a7-154c6bb5f3cf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1361 microversion: 2.1 time: 0.160024 Aug 24 17:50:00.168344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 75/150] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:00 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:00.510900 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-dd0513c9-bc73-443d-b448-f5c5b582bb1c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:00.511535 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-dd0513c9-bc73-443d-b448-f5c5b582bb1c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:00.517835 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dd0513c9-bc73-443d-b448-f5c5b582bb1c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:00.518354 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dd0513c9-bc73-443d-b448-f5c5b582bb1c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:00.518790 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dd0513c9-bc73-443d-b448-f5c5b582bb1c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:00.519482 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dd0513c9-bc73-443d-b448-f5c5b582bb1c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:00.519937 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dd0513c9-bc73-443d-b448-f5c5b582bb1c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:00.520356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dd0513c9-bc73-443d-b448-f5c5b582bb1c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:00.667318 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-dd0513c9-bc73-443d-b448-f5c5b582bb1c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:00.676588 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-dd0513c9-bc73-443d-b448-f5c5b582bb1c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1365 microversion: 2.1 time: 0.169531 Aug 24 17:50:00.677266 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 76/151] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:00 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:00.928277 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-848ff713-a119-420a-bd10-12ef769acecb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:00.928277 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-848ff713-a119-420a-bd10-12ef769acecb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:00.933075 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-848ff713-a119-420a-bd10-12ef769acecb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:00.933571 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-848ff713-a119-420a-bd10-12ef769acecb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:00.934100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-848ff713-a119-420a-bd10-12ef769acecb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:00.934806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-848ff713-a119-420a-bd10-12ef769acecb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:00.935267 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-848ff713-a119-420a-bd10-12ef769acecb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:00.935708 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-848ff713-a119-420a-bd10-12ef769acecb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:00.945898 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-b1e908e1-f952-4512-b137-2a128c5069f5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:00.946518 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-b1e908e1-f952-4512-b137-2a128c5069f5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:00.957713 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b1e908e1-f952-4512-b137-2a128c5069f5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:00.958468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b1e908e1-f952-4512-b137-2a128c5069f5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:00.962671 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b1e908e1-f952-4512-b137-2a128c5069f5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:00.962671 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b1e908e1-f952-4512-b137-2a128c5069f5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:00.962671 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b1e908e1-f952-4512-b137-2a128c5069f5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:00.962671 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b1e908e1-f952-4512-b137-2a128c5069f5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:01.148974 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-848ff713-a119-420a-bd10-12ef769acecb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:01.152220 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-b1e908e1-f952-4512-b137-2a128c5069f5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:01.160516 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-848ff713-a119-420a-bd10-12ef769acecb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:01.162240 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-848ff713-a119-420a-bd10-12ef769acecb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:01.163159 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-b1e908e1-f952-4512-b137-2a128c5069f5 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.221070 Aug 24 17:50:01.163538 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-848ff713-a119-420a-bd10-12ef769acecb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1405 microversion: 2.20 time: 0.242989 Aug 24 17:50:01.163918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 77/152] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:00 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:01.166184 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 76/153] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:00 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1405 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:01.189840 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-77dc9b50-2daf-47aa-a92d-1d03498f2fde tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:01.190476 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-77dc9b50-2daf-47aa-a92d-1d03498f2fde tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:01.196581 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-77dc9b50-2daf-47aa-a92d-1d03498f2fde tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:01.197058 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-77dc9b50-2daf-47aa-a92d-1d03498f2fde tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:01.197491 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-77dc9b50-2daf-47aa-a92d-1d03498f2fde tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:01.198227 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-77dc9b50-2daf-47aa-a92d-1d03498f2fde tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:01.198696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-77dc9b50-2daf-47aa-a92d-1d03498f2fde tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:01.199111 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-77dc9b50-2daf-47aa-a92d-1d03498f2fde tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:01.203143 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=100 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:01.353548 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-77dc9b50-2daf-47aa-a92d-1d03498f2fde tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:01.363741 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-77dc9b50-2daf-47aa-a92d-1d03498f2fde tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1361 microversion: 2.1 time: 0.178221 Aug 24 17:50:01.364349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 78/154] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:01 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:01.707284 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a283984d-b00d-43e7-9b98-f011b1f94479 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:01.707284 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a283984d-b00d-43e7-9b98-f011b1f94479 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:01.707284 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a283984d-b00d-43e7-9b98-f011b1f94479 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:01.707284 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a283984d-b00d-43e7-9b98-f011b1f94479 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:01.707820 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a283984d-b00d-43e7-9b98-f011b1f94479 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:01.707820 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a283984d-b00d-43e7-9b98-f011b1f94479 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:01.707820 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a283984d-b00d-43e7-9b98-f011b1f94479 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:01.707820 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a283984d-b00d-43e7-9b98-f011b1f94479 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:01.844148 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a283984d-b00d-43e7-9b98-f011b1f94479 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:01.852783 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a283984d-b00d-43e7-9b98-f011b1f94479 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1365 microversion: 2.1 time: 0.158422 Aug 24 17:50:01.853371 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 77/155] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:01 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:02.186529 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9fe66dc2-e725-43fe-9321-cda2dd97549b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:02.187143 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9fe66dc2-e725-43fe-9321-cda2dd97549b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:02.188834 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-639a336c-5114-40c5-a62a-4efe87bd7dda tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:02.189452 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-639a336c-5114-40c5-a62a-4efe87bd7dda tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:02.194758 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9fe66dc2-e725-43fe-9321-cda2dd97549b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:02.195533 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9fe66dc2-e725-43fe-9321-cda2dd97549b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:02.195977 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9fe66dc2-e725-43fe-9321-cda2dd97549b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:02.196244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-639a336c-5114-40c5-a62a-4efe87bd7dda tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:02.196706 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9fe66dc2-e725-43fe-9321-cda2dd97549b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:02.196893 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-639a336c-5114-40c5-a62a-4efe87bd7dda tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:02.197158 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9fe66dc2-e725-43fe-9321-cda2dd97549b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:02.197494 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-639a336c-5114-40c5-a62a-4efe87bd7dda tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:02.197932 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9fe66dc2-e725-43fe-9321-cda2dd97549b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:02.198326 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-639a336c-5114-40c5-a62a-4efe87bd7dda tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:02.198810 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-639a336c-5114-40c5-a62a-4efe87bd7dda tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:02.199234 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-639a336c-5114-40c5-a62a-4efe87bd7dda tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:02.421766 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-639a336c-5114-40c5-a62a-4efe87bd7dda tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:02.426237 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=100 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:02.427596 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9fe66dc2-e725-43fe-9321-cda2dd97549b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:02.431844 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-639a336c-5114-40c5-a62a-4efe87bd7dda tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:02.433574 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-639a336c-5114-40c5-a62a-4efe87bd7dda tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:02.434745 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-639a336c-5114-40c5-a62a-4efe87bd7dda tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1405 microversion: 2.20 time: 0.250402 Aug 24 17:50:02.435297 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 78/156] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:02 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:50:02.436346 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9fe66dc2-e725-43fe-9321-cda2dd97549b tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.255004 Aug 24 17:50:02.439584 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 79/157] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:02 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:50:02.441249 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-cc4cea75-c543-49b5-8710-daeb6409f940 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:02.442076 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-cc4cea75-c543-49b5-8710-daeb6409f940 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:02.449642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cc4cea75-c543-49b5-8710-daeb6409f940 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:02.450416 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cc4cea75-c543-49b5-8710-daeb6409f940 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:02.450953 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cc4cea75-c543-49b5-8710-daeb6409f940 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:02.451676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cc4cea75-c543-49b5-8710-daeb6409f940 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:02.452211 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cc4cea75-c543-49b5-8710-daeb6409f940 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:02.452729 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cc4cea75-c543-49b5-8710-daeb6409f940 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:02.601020 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-cc4cea75-c543-49b5-8710-daeb6409f940 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:02.609274 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-cc4cea75-c543-49b5-8710-daeb6409f940 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1361 microversion: 2.1 time: 0.172734 Aug 24 17:50:02.609878 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 79/158] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:02 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:02.874740 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3fb4e5ae-1358-4d60-8ba6-e2fe696daa10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:02.875351 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3fb4e5ae-1358-4d60-8ba6-e2fe696daa10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:02.882713 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3fb4e5ae-1358-4d60-8ba6-e2fe696daa10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:02.883198 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3fb4e5ae-1358-4d60-8ba6-e2fe696daa10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:02.883640 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3fb4e5ae-1358-4d60-8ba6-e2fe696daa10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:02.884331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3fb4e5ae-1358-4d60-8ba6-e2fe696daa10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:02.884774 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3fb4e5ae-1358-4d60-8ba6-e2fe696daa10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:02.885193 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3fb4e5ae-1358-4d60-8ba6-e2fe696daa10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:03.055899 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3fb4e5ae-1358-4d60-8ba6-e2fe696daa10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:03.066741 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3fb4e5ae-1358-4d60-8ba6-e2fe696daa10 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1365 microversion: 2.1 time: 0.195578 Aug 24 17:50:03.079762 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 80/159] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:02 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:03.358174 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-a3330616-e9cd-4f0c-9d29-e2d0c79df834 req-382da28e-da29-40fa-800b-3f0969d536ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd743b2-3b6c-4213-819a-1a25314ed5e2", "name": "network-vif-plugged", "status": "completed", "tag": "c21554ce-e587-47c2-9a5e-61d889373e08"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:03.372934 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-a3330616-e9cd-4f0c-9d29-e2d0c79df834 req-382da28e-da29-40fa-800b-3f0969d536ca service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:03.373413 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-a3330616-e9cd-4f0c-9d29-e2d0c79df834 req-382da28e-da29-40fa-800b-3f0969d536ca service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:03.373841 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-a3330616-e9cd-4f0c-9d29-e2d0c79df834 req-382da28e-da29-40fa-800b-3f0969d536ca service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:03.388261 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-a3330616-e9cd-4f0c-9d29-e2d0c79df834 req-382da28e-da29-40fa-800b-3f0969d536ca service nova] Creating event network-vif-plugged:c21554ce-e587-47c2-9a5e-61d889373e08 for instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 on hv-cinder-85442 Aug 24 17:50:03.395577 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-a3330616-e9cd-4f0c-9d29-e2d0c79df834 req-382da28e-da29-40fa-800b-3f0969d536ca service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043009 Aug 24 17:50:03.397064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 80/160] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:03.462643 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1ddcd3a7-b63c-4525-b5c0-af50723b8f4b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:03.465164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-034caab1-ffeb-42d0-8247-af1e0ddb5bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:03.465990 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-034caab1-ffeb-42d0-8247-af1e0ddb5bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:03.470308 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1ddcd3a7-b63c-4525-b5c0-af50723b8f4b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:03.480662 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-034caab1-ffeb-42d0-8247-af1e0ddb5bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:03.481170 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-034caab1-ffeb-42d0-8247-af1e0ddb5bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:03.481903 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-034caab1-ffeb-42d0-8247-af1e0ddb5bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:03.499403 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-034caab1-ffeb-42d0-8247-af1e0ddb5bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:03.499403 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-034caab1-ffeb-42d0-8247-af1e0ddb5bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:03.499403 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-034caab1-ffeb-42d0-8247-af1e0ddb5bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:03.511986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1ddcd3a7-b63c-4525-b5c0-af50723b8f4b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:03.519713 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1ddcd3a7-b63c-4525-b5c0-af50723b8f4b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:03.520727 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1ddcd3a7-b63c-4525-b5c0-af50723b8f4b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:03.522250 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1ddcd3a7-b63c-4525-b5c0-af50723b8f4b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:03.528628 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1ddcd3a7-b63c-4525-b5c0-af50723b8f4b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:03.530061 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1ddcd3a7-b63c-4525-b5c0-af50723b8f4b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:03.792713 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-034caab1-ffeb-42d0-8247-af1e0ddb5bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:03.816922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-034caab1-ffeb-42d0-8247-af1e0ddb5bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1315 microversion: 2.1 time: 0.356216 Aug 24 17:50:03.836949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 81/161] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:03 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:50:03.845718 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-aa425e32-5b53-420c-99e1-774fc551bf13 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:03.861913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-aa425e32-5b53-420c-99e1-774fc551bf13 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:03.880362 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-aa425e32-5b53-420c-99e1-774fc551bf13 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:03.880739 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1ddcd3a7-b63c-4525-b5c0-af50723b8f4b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:03.880876 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-aa425e32-5b53-420c-99e1-774fc551bf13 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:03.880876 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-aa425e32-5b53-420c-99e1-774fc551bf13 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:03.880876 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-aa425e32-5b53-420c-99e1-774fc551bf13 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:03.880876 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-aa425e32-5b53-420c-99e1-774fc551bf13 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:03.881196 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-aa425e32-5b53-420c-99e1-774fc551bf13 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:03.892716 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1ddcd3a7-b63c-4525-b5c0-af50723b8f4b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:03.896153 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1ddcd3a7-b63c-4525-b5c0-af50723b8f4b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:03.902374 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1ddcd3a7-b63c-4525-b5c0-af50723b8f4b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1405 microversion: 2.20 time: 0.446414 Aug 24 17:50:03.904060 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 81/162] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:03 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:04.089872 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-2de53043-8fa0-4fad-a7d7-5d437ef56852 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:04.090777 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-2de53043-8fa0-4fad-a7d7-5d437ef56852 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:04.099298 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-aa425e32-5b53-420c-99e1-774fc551bf13 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:04.100331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2de53043-8fa0-4fad-a7d7-5d437ef56852 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:04.101633 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2de53043-8fa0-4fad-a7d7-5d437ef56852 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:04.102428 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2de53043-8fa0-4fad-a7d7-5d437ef56852 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:04.103265 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2de53043-8fa0-4fad-a7d7-5d437ef56852 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:04.103934 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2de53043-8fa0-4fad-a7d7-5d437ef56852 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:04.104528 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2de53043-8fa0-4fad-a7d7-5d437ef56852 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:04.115960 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-aa425e32-5b53-420c-99e1-774fc551bf13 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1361 microversion: 2.1 time: 0.277267 Aug 24 17:50:04.117214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 82/163] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:03 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1361 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:04.251797 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-2de53043-8fa0-4fad-a7d7-5d437ef56852 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:04.260552 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-2de53043-8fa0-4fad-a7d7-5d437ef56852 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1365 microversion: 2.1 time: 0.175318 Aug 24 17:50:04.261385 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 82/164] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:04 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:04.846385 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-bd15406d-c0c6-4ece-bdf8-646c2a67e450 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:04.846956 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-bd15406d-c0c6-4ece-bdf8-646c2a67e450 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:04.854270 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bd15406d-c0c6-4ece-bdf8-646c2a67e450 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:04.858232 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bd15406d-c0c6-4ece-bdf8-646c2a67e450 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:04.858232 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bd15406d-c0c6-4ece-bdf8-646c2a67e450 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:04.858232 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bd15406d-c0c6-4ece-bdf8-646c2a67e450 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:04.858232 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bd15406d-c0c6-4ece-bdf8-646c2a67e450 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:04.858582 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bd15406d-c0c6-4ece-bdf8-646c2a67e450 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:04.944734 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-2f8b7d64-8548-438b-92a7-c68a6a8e0f58 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:04.945543 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-2f8b7d64-8548-438b-92a7-c68a6a8e0f58 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:04.956945 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2f8b7d64-8548-438b-92a7-c68a6a8e0f58 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:04.956945 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2f8b7d64-8548-438b-92a7-c68a6a8e0f58 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:04.958327 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2f8b7d64-8548-438b-92a7-c68a6a8e0f58 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:04.959494 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2f8b7d64-8548-438b-92a7-c68a6a8e0f58 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:04.960451 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2f8b7d64-8548-438b-92a7-c68a6a8e0f58 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:04.961228 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2f8b7d64-8548-438b-92a7-c68a6a8e0f58 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:05.185169 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-bd15406d-c0c6-4ece-bdf8-646c2a67e450 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:05.226592 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-bd15406d-c0c6-4ece-bdf8-646c2a67e450 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1501 microversion: 2.1 time: 0.386420 Aug 24 17:50:05.236821 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 83/165] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:04 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1501 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:50:05.241044 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-2f8b7d64-8548-438b-92a7-c68a6a8e0f58 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:05.256561 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-2f8b7d64-8548-438b-92a7-c68a6a8e0f58 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:05.256561 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-2f8b7d64-8548-438b-92a7-c68a6a8e0f58 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:05.256753 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-79af6f37-e0e1-414a-9997-0c492927d3c2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:05.257495 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-2f8b7d64-8548-438b-92a7-c68a6a8e0f58 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1405 microversion: 2.20 time: 0.315987 Aug 24 17:50:05.257930 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-79af6f37-e0e1-414a-9997-0c492927d3c2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:05.258576 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 83/166] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:04 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1405 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:50:05.276941 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-79af6f37-e0e1-414a-9997-0c492927d3c2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:05.280422 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-79af6f37-e0e1-414a-9997-0c492927d3c2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:05.285455 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-79af6f37-e0e1-414a-9997-0c492927d3c2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:05.285455 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-79af6f37-e0e1-414a-9997-0c492927d3c2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:05.286599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-79af6f37-e0e1-414a-9997-0c492927d3c2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:05.288246 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-79af6f37-e0e1-414a-9997-0c492927d3c2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:05.293366 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-91608176-026e-48df-b49d-9c36e96db429 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:05.294166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-91608176-026e-48df-b49d-9c36e96db429 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:05.304431 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-91608176-026e-48df-b49d-9c36e96db429 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:05.305650 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-91608176-026e-48df-b49d-9c36e96db429 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:05.306141 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-91608176-026e-48df-b49d-9c36e96db429 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:05.306870 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-91608176-026e-48df-b49d-9c36e96db429 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:05.307337 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-91608176-026e-48df-b49d-9c36e96db429 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:05.307765 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-91608176-026e-48df-b49d-9c36e96db429 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:05.679067 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-79af6f37-e0e1-414a-9997-0c492927d3c2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:05.689183 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-79af6f37-e0e1-414a-9997-0c492927d3c2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1361 microversion: 2.1 time: 0.450172 Aug 24 17:50:05.690060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 84/167] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:05 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1361 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:05.698274 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-46a8458c-8d6e-4f4a-9d56-f88c42c30df7 req-bf9802fd-efdf-4f61-a526-66dd1ae04764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "154f9aac-b081-4041-ba41-dd14fb267e29", "name": "network-vif-plugged", "status": "completed", "tag": "12033839-1050-4fb0-90d7-ede010ae619a"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:05.705886 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=100 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:05.710701 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-46a8458c-8d6e-4f4a-9d56-f88c42c30df7 req-bf9802fd-efdf-4f61-a526-66dd1ae04764 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:05.711191 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-46a8458c-8d6e-4f4a-9d56-f88c42c30df7 req-bf9802fd-efdf-4f61-a526-66dd1ae04764 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:05.711630 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-46a8458c-8d6e-4f4a-9d56-f88c42c30df7 req-bf9802fd-efdf-4f61-a526-66dd1ae04764 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:05.724077 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-91608176-026e-48df-b49d-9c36e96db429 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:05.734529 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-46a8458c-8d6e-4f4a-9d56-f88c42c30df7 req-bf9802fd-efdf-4f61-a526-66dd1ae04764 service nova] Creating event network-vif-plugged:12033839-1050-4fb0-90d7-ede010ae619a for instance 154f9aac-b081-4041-ba41-dd14fb267e29 on hv-cinder-85442 Aug 24 17:50:05.742078 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-91608176-026e-48df-b49d-9c36e96db429 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1365 microversion: 2.1 time: 0.448117 Aug 24 17:50:05.742078 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 84/168] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:05 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1365 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:50:05.743327 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-46a8458c-8d6e-4f4a-9d56-f88c42c30df7 req-bf9802fd-efdf-4f61-a526-66dd1ae04764 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051825 Aug 24 17:50:05.744268 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 85/169] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:06.303861 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c092f18a-0208-4bd1-afe8-bca0a57d3929 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:06.306028 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c092f18a-0208-4bd1-afe8-bca0a57d3929 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:06.317639 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c092f18a-0208-4bd1-afe8-bca0a57d3929 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:06.318179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c092f18a-0208-4bd1-afe8-bca0a57d3929 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:06.318703 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c092f18a-0208-4bd1-afe8-bca0a57d3929 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:06.319808 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c092f18a-0208-4bd1-afe8-bca0a57d3929 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:06.320527 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c092f18a-0208-4bd1-afe8-bca0a57d3929 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:06.321179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c092f18a-0208-4bd1-afe8-bca0a57d3929 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:06.568874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c092f18a-0208-4bd1-afe8-bca0a57d3929 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:06.578324 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c092f18a-0208-4bd1-afe8-bca0a57d3929 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:06.580925 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c092f18a-0208-4bd1-afe8-bca0a57d3929 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:06.582413 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c092f18a-0208-4bd1-afe8-bca0a57d3929 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1405 microversion: 2.20 time: 0.287475 Aug 24 17:50:06.598638 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 85/170] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:06 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1405 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:06.717145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f58d5aa0-8c15-473b-810f-e7436c4727cc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:06.718994 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f58d5aa0-8c15-473b-810f-e7436c4727cc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:06.727002 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f58d5aa0-8c15-473b-810f-e7436c4727cc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:06.727824 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f58d5aa0-8c15-473b-810f-e7436c4727cc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:06.728610 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f58d5aa0-8c15-473b-810f-e7436c4727cc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:06.729192 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f58d5aa0-8c15-473b-810f-e7436c4727cc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:06.729920 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f58d5aa0-8c15-473b-810f-e7436c4727cc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:06.730421 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f58d5aa0-8c15-473b-810f-e7436c4727cc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:06.765836 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-691d9f0c-ce7e-4bd8-bd71-66037af1dfe2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:06.768643 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-691d9f0c-ce7e-4bd8-bd71-66037af1dfe2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:06.778988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-691d9f0c-ce7e-4bd8-bd71-66037af1dfe2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:06.780078 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-691d9f0c-ce7e-4bd8-bd71-66037af1dfe2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:06.780829 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-691d9f0c-ce7e-4bd8-bd71-66037af1dfe2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:06.783543 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-691d9f0c-ce7e-4bd8-bd71-66037af1dfe2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:06.784421 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-691d9f0c-ce7e-4bd8-bd71-66037af1dfe2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:06.785128 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-691d9f0c-ce7e-4bd8-bd71-66037af1dfe2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:07.082435 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f58d5aa0-8c15-473b-810f-e7436c4727cc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:07.091735 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f58d5aa0-8c15-473b-810f-e7436c4727cc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1361 microversion: 2.1 time: 0.378627 Aug 24 17:50:07.092946 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 86/171] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:06 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1361 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:07.108506 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-691d9f0c-ce7e-4bd8-bd71-66037af1dfe2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:07.118130 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-691d9f0c-ce7e-4bd8-bd71-66037af1dfe2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1555 microversion: 2.1 time: 0.359710 Aug 24 17:50:07.118717 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 86/172] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:06 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1555 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:07.139966 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f86292c4-3362-4a94-8fa8-429210a8e138 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:07.140450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f86292c4-3362-4a94-8fa8-429210a8e138 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:07.149983 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f86292c4-3362-4a94-8fa8-429210a8e138 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:07.150496 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f86292c4-3362-4a94-8fa8-429210a8e138 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:07.150994 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f86292c4-3362-4a94-8fa8-429210a8e138 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:07.151709 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f86292c4-3362-4a94-8fa8-429210a8e138 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:07.152189 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f86292c4-3362-4a94-8fa8-429210a8e138 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:07.152604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f86292c4-3362-4a94-8fa8-429210a8e138 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:07.347898 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f86292c4-3362-4a94-8fa8-429210a8e138 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211669 Aug 24 17:50:07.348664 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 87/173] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 24 17:50:07 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:07.452061 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ff5c3341-73a6-4553-ac75-7fa2a9653b5f tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0c1ae3d-7039-45a4-baf9-3d725e1ccf13"}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:07.455920 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ff5c3341-73a6-4553-ac75-7fa2a9653b5f tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:07.462656 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ff5c3341-73a6-4553-ac75-7fa2a9653b5f tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:07.463352 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ff5c3341-73a6-4553-ac75-7fa2a9653b5f tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:07.463955 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ff5c3341-73a6-4553-ac75-7fa2a9653b5f tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:07.465455 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ff5c3341-73a6-4553-ac75-7fa2a9653b5f tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:07.466161 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ff5c3341-73a6-4553-ac75-7fa2a9653b5f tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:07.466523 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ff5c3341-73a6-4553-ac75-7fa2a9653b5f tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:07.606975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7e766225-11a4-459e-b9e3-2285617d43ff tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:07.607590 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7e766225-11a4-459e-b9e3-2285617d43ff tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:07.620440 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7e766225-11a4-459e-b9e3-2285617d43ff tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:07.621394 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7e766225-11a4-459e-b9e3-2285617d43ff tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:07.622069 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7e766225-11a4-459e-b9e3-2285617d43ff tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:07.623075 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7e766225-11a4-459e-b9e3-2285617d43ff tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:07.624206 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7e766225-11a4-459e-b9e3-2285617d43ff tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:07.624975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7e766225-11a4-459e-b9e3-2285617d43ff tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:07.852473 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7e766225-11a4-459e-b9e3-2285617d43ff tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:07.866612 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7e766225-11a4-459e-b9e3-2285617d43ff tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:07.868217 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7e766225-11a4-459e-b9e3-2285617d43ff tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:07.869963 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7e766225-11a4-459e-b9e3-2285617d43ff tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1405 microversion: 2.20 time: 0.267155 Aug 24 17:50:07.870545 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 88/174] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:07 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1405 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:50:07.877109 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-77e304cd-e6a4-43f4-965e-d0ee914dbebb req-d1f4edb1-604f-4d15-a787-20a18e01f15f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec9a988c-b152-4e39-ad48-c2f7facd203f", "name": "network-vif-plugged", "status": "completed", "tag": "d93fe402-2e98-4ff9-8441-854219d9e667"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:07.887964 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-77e304cd-e6a4-43f4-965e-d0ee914dbebb req-d1f4edb1-604f-4d15-a787-20a18e01f15f service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:07.888688 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-77e304cd-e6a4-43f4-965e-d0ee914dbebb req-d1f4edb1-604f-4d15-a787-20a18e01f15f service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:07.889289 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-77e304cd-e6a4-43f4-965e-d0ee914dbebb req-d1f4edb1-604f-4d15-a787-20a18e01f15f service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:07.902974 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-77e304cd-e6a4-43f4-965e-d0ee914dbebb req-d1f4edb1-604f-4d15-a787-20a18e01f15f service nova] Creating event network-vif-plugged:d93fe402-2e98-4ff9-8441-854219d9e667 for instance ec9a988c-b152-4e39-ad48-c2f7facd203f on hv-cinder-85442 Aug 24 17:50:07.909109 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-77e304cd-e6a4-43f4-965e-d0ee914dbebb req-d1f4edb1-604f-4d15-a787-20a18e01f15f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037170 Aug 24 17:50:07.909721 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 89/175] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:08.116374 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-6980bf44-17c6-45fe-b2d8-981b54d5a24b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:08.117307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-6980bf44-17c6-45fe-b2d8-981b54d5a24b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:08.129454 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6980bf44-17c6-45fe-b2d8-981b54d5a24b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:08.130544 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6980bf44-17c6-45fe-b2d8-981b54d5a24b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:08.131329 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6980bf44-17c6-45fe-b2d8-981b54d5a24b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:08.132382 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6980bf44-17c6-45fe-b2d8-981b54d5a24b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:08.133079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6980bf44-17c6-45fe-b2d8-981b54d5a24b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:08.133777 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6980bf44-17c6-45fe-b2d8-981b54d5a24b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:08.311659 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-6980bf44-17c6-45fe-b2d8-981b54d5a24b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:08.320471 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-6980bf44-17c6-45fe-b2d8-981b54d5a24b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1361 microversion: 2.1 time: 0.208957 Aug 24 17:50:08.321416 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 90/176] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:08 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:08.897524 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-755531a1-4559-47bf-b2f2-239b6ed8bfd1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:08.898365 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-755531a1-4559-47bf-b2f2-239b6ed8bfd1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:08.908810 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-755531a1-4559-47bf-b2f2-239b6ed8bfd1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:08.909502 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-755531a1-4559-47bf-b2f2-239b6ed8bfd1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:08.910184 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-755531a1-4559-47bf-b2f2-239b6ed8bfd1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:08.911237 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-755531a1-4559-47bf-b2f2-239b6ed8bfd1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:08.911849 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-755531a1-4559-47bf-b2f2-239b6ed8bfd1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:08.916066 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-755531a1-4559-47bf-b2f2-239b6ed8bfd1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:09.083397 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-755531a1-4559-47bf-b2f2-239b6ed8bfd1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:09.089925 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-755531a1-4559-47bf-b2f2-239b6ed8bfd1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:09.091606 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-755531a1-4559-47bf-b2f2-239b6ed8bfd1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:09.092964 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-755531a1-4559-47bf-b2f2-239b6ed8bfd1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1405 microversion: 2.20 time: 0.200852 Aug 24 17:50:09.093943 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 91/177] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:08 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:09.218313 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-bbae4bb7-d11f-4eb7-abe4-943e45edd1e2 req-6a3467ae-9c14-4026-ae59-ff32cef0a19d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd743b2-3b6c-4213-819a-1a25314ed5e2", "tag": "c21554ce-e587-47c2-9a5e-61d889373e08"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:09.229708 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-bbae4bb7-d11f-4eb7-abe4-943e45edd1e2 req-6a3467ae-9c14-4026-ae59-ff32cef0a19d service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:09.230334 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-bbae4bb7-d11f-4eb7-abe4-943e45edd1e2 req-6a3467ae-9c14-4026-ae59-ff32cef0a19d service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:09.230843 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-bbae4bb7-d11f-4eb7-abe4-943e45edd1e2 req-6a3467ae-9c14-4026-ae59-ff32cef0a19d service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:09.244362 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-bbae4bb7-d11f-4eb7-abe4-943e45edd1e2 req-6a3467ae-9c14-4026-ae59-ff32cef0a19d service nova] Creating event network-changed:c21554ce-e587-47c2-9a5e-61d889373e08 for instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 on hv-cinder-85442 Aug 24 17:50:09.250127 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-bbae4bb7-d11f-4eb7-abe4-943e45edd1e2 req-6a3467ae-9c14-4026-ae59-ff32cef0a19d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035602 Aug 24 17:50:09.251421 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 92/178] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:50:09.345915 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-903a56ce-a721-439c-8b32-4f10dec17aef tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:09.346612 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-903a56ce-a721-439c-8b32-4f10dec17aef tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:09.362390 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-903a56ce-a721-439c-8b32-4f10dec17aef tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:09.363918 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-903a56ce-a721-439c-8b32-4f10dec17aef tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:09.365712 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-903a56ce-a721-439c-8b32-4f10dec17aef tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:09.367267 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-903a56ce-a721-439c-8b32-4f10dec17aef tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:09.368383 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-903a56ce-a721-439c-8b32-4f10dec17aef tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:09.370926 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-903a56ce-a721-439c-8b32-4f10dec17aef tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:09.548577 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-903a56ce-a721-439c-8b32-4f10dec17aef tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:09.556364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-903a56ce-a721-439c-8b32-4f10dec17aef tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1361 microversion: 2.1 time: 0.216928 Aug 24 17:50:09.556945 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 93/179] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:09 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:10.120626 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-c1287a4c-5dd4-4134-ae1a-59143c94b3f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:10.121389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-c1287a4c-5dd4-4134-ae1a-59143c94b3f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:10.127972 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c1287a4c-5dd4-4134-ae1a-59143c94b3f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:10.128460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c1287a4c-5dd4-4134-ae1a-59143c94b3f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:10.128891 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c1287a4c-5dd4-4134-ae1a-59143c94b3f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:10.129595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c1287a4c-5dd4-4134-ae1a-59143c94b3f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:10.130077 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c1287a4c-5dd4-4134-ae1a-59143c94b3f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:10.130533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c1287a4c-5dd4-4134-ae1a-59143c94b3f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:10.301559 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c1287a4c-5dd4-4134-ae1a-59143c94b3f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:10.312355 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c1287a4c-5dd4-4134-ae1a-59143c94b3f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:10.314446 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c1287a4c-5dd4-4134-ae1a-59143c94b3f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:10.317094 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-c1287a4c-5dd4-4134-ae1a-59143c94b3f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1405 microversion: 2.20 time: 0.198830 Aug 24 17:50:10.317094 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 94/180] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:10 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1405 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:10.581319 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7b7986a8-bfe4-449d-b790-3725f37327f7 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:10.582311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7b7986a8-bfe4-449d-b790-3725f37327f7 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:10.588811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7b7986a8-bfe4-449d-b790-3725f37327f7 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:10.589426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7b7986a8-bfe4-449d-b790-3725f37327f7 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:10.589880 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7b7986a8-bfe4-449d-b790-3725f37327f7 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:10.590591 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7b7986a8-bfe4-449d-b790-3725f37327f7 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:10.591146 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7b7986a8-bfe4-449d-b790-3725f37327f7 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:10.591572 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7b7986a8-bfe4-449d-b790-3725f37327f7 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:10.756979 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7b7986a8-bfe4-449d-b790-3725f37327f7 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:10.765178 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7b7986a8-bfe4-449d-b790-3725f37327f7 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1361 microversion: 2.1 time: 0.189818 Aug 24 17:50:10.774163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 95/181] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:10 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1361 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:50:11.343519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-26c73ad3-ca4c-4238-9807-e55fbcd19602 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:11.344824 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-26c73ad3-ca4c-4238-9807-e55fbcd19602 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:11.354399 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-26c73ad3-ca4c-4238-9807-e55fbcd19602 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:11.354399 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-26c73ad3-ca4c-4238-9807-e55fbcd19602 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:11.354399 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-26c73ad3-ca4c-4238-9807-e55fbcd19602 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:11.354971 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-26c73ad3-ca4c-4238-9807-e55fbcd19602 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:11.355350 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-26c73ad3-ca4c-4238-9807-e55fbcd19602 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:11.356602 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-26c73ad3-ca4c-4238-9807-e55fbcd19602 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:11.907503 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-26c73ad3-ca4c-4238-9807-e55fbcd19602 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:11.921806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-26c73ad3-ca4c-4238-9807-e55fbcd19602 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:11.924008 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-26c73ad3-ca4c-4238-9807-e55fbcd19602 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:11.926462 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-26c73ad3-ca4c-4238-9807-e55fbcd19602 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1596 microversion: 2.20 time: 0.590101 Aug 24 17:50:11.929621 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 96/182] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:11 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1596 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:11.948459 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-732f88e4-3ed8-4bc8-92fc-9a13afebef3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:11.951592 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-732f88e4-3ed8-4bc8-92fc-9a13afebef3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:11.961134 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-732f88e4-3ed8-4bc8-92fc-9a13afebef3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:11.965437 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-732f88e4-3ed8-4bc8-92fc-9a13afebef3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:11.965437 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-732f88e4-3ed8-4bc8-92fc-9a13afebef3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:11.965437 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-732f88e4-3ed8-4bc8-92fc-9a13afebef3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:11.965437 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-732f88e4-3ed8-4bc8-92fc-9a13afebef3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:11.966049 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-732f88e4-3ed8-4bc8-92fc-9a13afebef3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:12.110466 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ff5c3341-73a6-4553-ac75-7fa2a9653b5f tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "POST /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.662723 Aug 24 17:50:12.117212 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 87/183] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 17:50:07 2022] POST /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db/os-volume_attachments => generated 194 bytes in 4668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:12.131169 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-b877bec6-7b8a-4ca7-aa55-ada35e7a7ed9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:12.133038 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-b877bec6-7b8a-4ca7-aa55-ada35e7a7ed9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:12.145763 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=83 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:12.147627 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b877bec6-7b8a-4ca7-aa55-ada35e7a7ed9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:12.148552 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b877bec6-7b8a-4ca7-aa55-ada35e7a7ed9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:12.152936 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b877bec6-7b8a-4ca7-aa55-ada35e7a7ed9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:12.161954 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b877bec6-7b8a-4ca7-aa55-ada35e7a7ed9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:12.161954 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b877bec6-7b8a-4ca7-aa55-ada35e7a7ed9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:12.161954 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b877bec6-7b8a-4ca7-aa55-ada35e7a7ed9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:12.168526 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-732f88e4-3ed8-4bc8-92fc-9a13afebef3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:12.177825 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-732f88e4-3ed8-4bc8-92fc-9a13afebef3d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1361 microversion: 2.1 time: 0.246890 Aug 24 17:50:12.178786 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 97/184] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:11 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1361 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:12.299321 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-b877bec6-7b8a-4ca7-aa55-ada35e7a7ed9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.182624 Aug 24 17:50:12.300030 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 88/185] 10.222.0.76 () {60 vars in 1316 bytes} [Wed Aug 24 17:50:12 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/os-interface => generated 284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:50:13.200702 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-be5322a9-7ec7-4971-8dc3-b10d97d91834 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:13.201433 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-be5322a9-7ec7-4971-8dc3-b10d97d91834 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:13.229345 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-be5322a9-7ec7-4971-8dc3-b10d97d91834 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:13.232902 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-be5322a9-7ec7-4971-8dc3-b10d97d91834 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:13.238193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-be5322a9-7ec7-4971-8dc3-b10d97d91834 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:13.241645 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-be5322a9-7ec7-4971-8dc3-b10d97d91834 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:13.242448 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-be5322a9-7ec7-4971-8dc3-b10d97d91834 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:13.245373 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-be5322a9-7ec7-4971-8dc3-b10d97d91834 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:13.296271 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=100 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:13.552200 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-be5322a9-7ec7-4971-8dc3-b10d97d91834 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:13.571730 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-be5322a9-7ec7-4971-8dc3-b10d97d91834 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1361 microversion: 2.1 time: 0.375926 Aug 24 17:50:13.572406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 98/186] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:13 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1361 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:13.828471 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-9b5558b1-4395-439f-a8a1-4a5384da2873 req-eb6e446d-c310-4e0a-8725-5d942e807fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "154f9aac-b081-4041-ba41-dd14fb267e29", "tag": "12033839-1050-4fb0-90d7-ede010ae619a"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:13.845647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-9b5558b1-4395-439f-a8a1-4a5384da2873 req-eb6e446d-c310-4e0a-8725-5d942e807fb2 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:13.846412 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-9b5558b1-4395-439f-a8a1-4a5384da2873 req-eb6e446d-c310-4e0a-8725-5d942e807fb2 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:13.847389 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-9b5558b1-4395-439f-a8a1-4a5384da2873 req-eb6e446d-c310-4e0a-8725-5d942e807fb2 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:13.878801 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-9b5558b1-4395-439f-a8a1-4a5384da2873 req-eb6e446d-c310-4e0a-8725-5d942e807fb2 service nova] Creating event network-changed:12033839-1050-4fb0-90d7-ede010ae619a for instance 154f9aac-b081-4041-ba41-dd14fb267e29 on hv-cinder-85442 Aug 24 17:50:13.878801 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-9b5558b1-4395-439f-a8a1-4a5384da2873 req-eb6e446d-c310-4e0a-8725-5d942e807fb2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048146 Aug 24 17:50:13.878801 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 89/187] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:14.597901 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-9aa28bf9-06ee-4f9f-be3a-c1fe70aa3c9b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:14.598639 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-9aa28bf9-06ee-4f9f-be3a-c1fe70aa3c9b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:14.605073 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9aa28bf9-06ee-4f9f-be3a-c1fe70aa3c9b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:14.605661 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9aa28bf9-06ee-4f9f-be3a-c1fe70aa3c9b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:14.606223 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9aa28bf9-06ee-4f9f-be3a-c1fe70aa3c9b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:14.607240 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9aa28bf9-06ee-4f9f-be3a-c1fe70aa3c9b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:14.607712 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9aa28bf9-06ee-4f9f-be3a-c1fe70aa3c9b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:14.608161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9aa28bf9-06ee-4f9f-be3a-c1fe70aa3c9b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:14.756005 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-9aa28bf9-06ee-4f9f-be3a-c1fe70aa3c9b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:14.764836 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-9aa28bf9-06ee-4f9f-be3a-c1fe70aa3c9b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1361 microversion: 2.1 time: 0.171967 Aug 24 17:50:14.765418 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 99/188] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:14 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:15.792093 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-db509e96-13e5-4cfd-876f-dc8ce4fee224 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:15.792711 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-db509e96-13e5-4cfd-876f-dc8ce4fee224 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:15.799400 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-db509e96-13e5-4cfd-876f-dc8ce4fee224 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:15.799873 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-db509e96-13e5-4cfd-876f-dc8ce4fee224 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:15.800301 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-db509e96-13e5-4cfd-876f-dc8ce4fee224 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:15.800993 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-db509e96-13e5-4cfd-876f-dc8ce4fee224 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:15.801463 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-db509e96-13e5-4cfd-876f-dc8ce4fee224 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:15.801899 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-db509e96-13e5-4cfd-876f-dc8ce4fee224 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:15.949955 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-db509e96-13e5-4cfd-876f-dc8ce4fee224 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:15.959311 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-db509e96-13e5-4cfd-876f-dc8ce4fee224 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1361 microversion: 2.1 time: 0.174562 Aug 24 17:50:15.960022 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 90/189] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:15 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:16.980643 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d2f0a952-9b6b-46e9-b91d-4d349fc763b5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:16.981445 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d2f0a952-9b6b-46e9-b91d-4d349fc763b5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:16.988460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d2f0a952-9b6b-46e9-b91d-4d349fc763b5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:16.988954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d2f0a952-9b6b-46e9-b91d-4d349fc763b5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:16.989397 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d2f0a952-9b6b-46e9-b91d-4d349fc763b5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:16.990110 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d2f0a952-9b6b-46e9-b91d-4d349fc763b5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:16.990564 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d2f0a952-9b6b-46e9-b91d-4d349fc763b5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:16.990985 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d2f0a952-9b6b-46e9-b91d-4d349fc763b5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:17.130106 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d2f0a952-9b6b-46e9-b91d-4d349fc763b5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:17.138919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d2f0a952-9b6b-46e9-b91d-4d349fc763b5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1547 microversion: 2.1 time: 0.162145 Aug 24 17:50:17.139513 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 100/190] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:16 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:17.162023 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-5079de94-8aa6-4b4e-a2d2-a343286bc6df tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:17.162555 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-5079de94-8aa6-4b4e-a2d2-a343286bc6df tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:17.169346 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5079de94-8aa6-4b4e-a2d2-a343286bc6df tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:17.169748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5079de94-8aa6-4b4e-a2d2-a343286bc6df tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:17.170205 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5079de94-8aa6-4b4e-a2d2-a343286bc6df tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:17.170901 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5079de94-8aa6-4b4e-a2d2-a343286bc6df tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:17.171347 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5079de94-8aa6-4b4e-a2d2-a343286bc6df tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:17.172313 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5079de94-8aa6-4b4e-a2d2-a343286bc6df tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:17.261389 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-5079de94-8aa6-4b4e-a2d2-a343286bc6df tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102513 Aug 24 17:50:17.264451 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 91/191] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 24 17:50:17 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:18.773362 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-4614328a-5a43-4459-b7d3-45e0dc295ea3 req-e376bb43-4aa9-4592-9e10-4fa87076719c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec9a988c-b152-4e39-ad48-c2f7facd203f", "tag": "d93fe402-2e98-4ff9-8441-854219d9e667"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:18.784043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-4614328a-5a43-4459-b7d3-45e0dc295ea3 req-e376bb43-4aa9-4592-9e10-4fa87076719c service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:18.784847 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-4614328a-5a43-4459-b7d3-45e0dc295ea3 req-e376bb43-4aa9-4592-9e10-4fa87076719c service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:18.785291 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-4614328a-5a43-4459-b7d3-45e0dc295ea3 req-e376bb43-4aa9-4592-9e10-4fa87076719c service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:18.798884 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-4614328a-5a43-4459-b7d3-45e0dc295ea3 req-e376bb43-4aa9-4592-9e10-4fa87076719c service nova] Creating event network-changed:d93fe402-2e98-4ff9-8441-854219d9e667 for instance ec9a988c-b152-4e39-ad48-c2f7facd203f on hv-cinder-85442 Aug 24 17:50:18.804520 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-4614328a-5a43-4459-b7d3-45e0dc295ea3 req-e376bb43-4aa9-4592-9e10-4fa87076719c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034918 Aug 24 17:50:18.805140 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 101/192] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:28.667014 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=7 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:28.668319 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:28.672570 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d5ff999e-3436-429f-9f71-88da96700bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:28.673138 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d5ff999e-3436-429f-9f71-88da96700bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:28.680848 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d5ff999e-3436-429f-9f71-88da96700bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:28.681328 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d5ff999e-3436-429f-9f71-88da96700bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:28.681755 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d5ff999e-3436-429f-9f71-88da96700bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:28.682480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d5ff999e-3436-429f-9f71-88da96700bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:28.682923 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d5ff999e-3436-429f-9f71-88da96700bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:28.683333 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d5ff999e-3436-429f-9f71-88da96700bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:28.710103 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d5ff999e-3436-429f-9f71-88da96700bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Going to try to terminate instance {{(pid=127677) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:50:29.124010 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d5ff999e-3436-429f-9f71-88da96700bb4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "DELETE /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 204 len: 0 microversion: 2.1 time: 0.458069 Aug 24 17:50:29.124585 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 92/193] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:50:28 2022] DELETE /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:50:29.131656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=32 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:29.132879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=16 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:29.137912 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-81bd250d-63a7-4a0a-a27d-c09f517d6ed4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:29.138760 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-81bd250d-63a7-4a0a-a27d-c09f517d6ed4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:29.146663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-81bd250d-63a7-4a0a-a27d-c09f517d6ed4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:29.147266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-81bd250d-63a7-4a0a-a27d-c09f517d6ed4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:29.147636 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-81bd250d-63a7-4a0a-a27d-c09f517d6ed4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:29.148343 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-81bd250d-63a7-4a0a-a27d-c09f517d6ed4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:29.148805 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-81bd250d-63a7-4a0a-a27d-c09f517d6ed4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:29.149300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-81bd250d-63a7-4a0a-a27d-c09f517d6ed4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:29.383583 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-81bd250d-63a7-4a0a-a27d-c09f517d6ed4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:29.392731 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-81bd250d-63a7-4a0a-a27d-c09f517d6ed4 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1553 microversion: 2.1 time: 0.262351 Aug 24 17:50:29.393414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 102/194] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:29 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1553 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:50:30.421008 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-90caae65-cd51-4662-86f0-0bf9519230aa tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:30.431406 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-90caae65-cd51-4662-86f0-0bf9519230aa tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:30.431406 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90caae65-cd51-4662-86f0-0bf9519230aa tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:30.431406 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90caae65-cd51-4662-86f0-0bf9519230aa tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:30.431406 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90caae65-cd51-4662-86f0-0bf9519230aa tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:30.432149 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90caae65-cd51-4662-86f0-0bf9519230aa tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:30.432779 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90caae65-cd51-4662-86f0-0bf9519230aa tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:30.433172 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90caae65-cd51-4662-86f0-0bf9519230aa tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:30.609402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-90caae65-cd51-4662-86f0-0bf9519230aa tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:30.625823 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-90caae65-cd51-4662-86f0-0bf9519230aa tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1553 microversion: 2.1 time: 0.212229 Aug 24 17:50:30.626869 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 93/195] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:30 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1553 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:31.649237 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ae1679ea-ef44-4354-8fcf-9878788427c6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:31.650032 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-ae1679ea-ef44-4354-8fcf-9878788427c6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:31.670426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ae1679ea-ef44-4354-8fcf-9878788427c6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:31.670426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ae1679ea-ef44-4354-8fcf-9878788427c6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:31.670426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ae1679ea-ef44-4354-8fcf-9878788427c6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:31.670426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ae1679ea-ef44-4354-8fcf-9878788427c6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:31.670763 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ae1679ea-ef44-4354-8fcf-9878788427c6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:31.670763 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ae1679ea-ef44-4354-8fcf-9878788427c6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:31.823405 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-ae1679ea-ef44-4354-8fcf-9878788427c6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:31.833171 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-ae1679ea-ef44-4354-8fcf-9878788427c6 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1553 microversion: 2.1 time: 0.188884 Aug 24 17:50:31.834259 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 103/196] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:31 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:32.853825 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-eef6cffa-3e3b-4b9c-9eae-ce7efab86cbf tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:32.854546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-eef6cffa-3e3b-4b9c-9eae-ce7efab86cbf tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:32.861247 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eef6cffa-3e3b-4b9c-9eae-ce7efab86cbf tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:32.861900 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eef6cffa-3e3b-4b9c-9eae-ce7efab86cbf tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:32.864906 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eef6cffa-3e3b-4b9c-9eae-ce7efab86cbf tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:32.864906 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eef6cffa-3e3b-4b9c-9eae-ce7efab86cbf tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:32.864906 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eef6cffa-3e3b-4b9c-9eae-ce7efab86cbf tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:32.864906 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eef6cffa-3e3b-4b9c-9eae-ce7efab86cbf tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:33.056022 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-eef6cffa-3e3b-4b9c-9eae-ce7efab86cbf tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:33.065242 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-eef6cffa-3e3b-4b9c-9eae-ce7efab86cbf tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1553 microversion: 2.1 time: 0.215204 Aug 24 17:50:33.065827 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 94/197] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:32 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1553 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:34.087222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-bbf2da67-5f76-4817-bc19-a2c3af68c045 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:34.087960 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-bbf2da67-5f76-4817-bc19-a2c3af68c045 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:34.095136 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bbf2da67-5f76-4817-bc19-a2c3af68c045 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:34.095633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bbf2da67-5f76-4817-bc19-a2c3af68c045 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:34.096062 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bbf2da67-5f76-4817-bc19-a2c3af68c045 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:34.096777 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bbf2da67-5f76-4817-bc19-a2c3af68c045 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:34.097234 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bbf2da67-5f76-4817-bc19-a2c3af68c045 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:34.097665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bbf2da67-5f76-4817-bc19-a2c3af68c045 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:34.242260 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-bbf2da67-5f76-4817-bc19-a2c3af68c045 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:34.251252 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-bbf2da67-5f76-4817-bc19-a2c3af68c045 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1553 microversion: 2.1 time: 0.168087 Aug 24 17:50:34.252291 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 104/198] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:34 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:35.273949 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-827f7ea7-ddea-461f-b533-5e76078cd349 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:35.274703 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-827f7ea7-ddea-461f-b533-5e76078cd349 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:35.284308 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-827f7ea7-ddea-461f-b533-5e76078cd349 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:35.290223 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-827f7ea7-ddea-461f-b533-5e76078cd349 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:35.290223 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-827f7ea7-ddea-461f-b533-5e76078cd349 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:35.290223 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-827f7ea7-ddea-461f-b533-5e76078cd349 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:35.290223 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-827f7ea7-ddea-461f-b533-5e76078cd349 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:35.290883 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-827f7ea7-ddea-461f-b533-5e76078cd349 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:35.460429 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-827f7ea7-ddea-461f-b533-5e76078cd349 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:35.511546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-827f7ea7-ddea-461f-b533-5e76078cd349 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1553 microversion: 2.1 time: 0.239157 Aug 24 17:50:35.511702 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 95/199] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:35 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1553 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:35.614283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-62bfa5ca-c310-4ad9-b609-88aa68624ffa req-d4e67358-570d-4a76-a780-e24cc61975c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cdde8bf-31af-4304-8f4e-025156ca51db", "name": "network-vif-deleted", "tag": "50953070-74ca-4fab-9f1c-1e78ed898180"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:35.625175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-62bfa5ca-c310-4ad9-b609-88aa68624ffa req-d4e67358-570d-4a76-a780-e24cc61975c9 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:35.626563 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-62bfa5ca-c310-4ad9-b609-88aa68624ffa req-d4e67358-570d-4a76-a780-e24cc61975c9 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:35.627309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-62bfa5ca-c310-4ad9-b609-88aa68624ffa req-d4e67358-570d-4a76-a780-e24cc61975c9 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:35.644164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-62bfa5ca-c310-4ad9-b609-88aa68624ffa req-d4e67358-570d-4a76-a780-e24cc61975c9 service nova] Creating event network-vif-deleted:50953070-74ca-4fab-9f1c-1e78ed898180 for instance 4cdde8bf-31af-4304-8f4e-025156ca51db on hv-cinder-85442 Aug 24 17:50:35.649882 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-62bfa5ca-c310-4ad9-b609-88aa68624ffa req-d4e67358-570d-4a76-a780-e24cc61975c9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040608 Aug 24 17:50:35.650723 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 105/200] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:50:36.552966 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f187b9f1-894b-4b63-b16a-7d6ef158fa0e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:36.553879 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-f187b9f1-894b-4b63-b16a-7d6ef158fa0e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:36.561350 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f187b9f1-894b-4b63-b16a-7d6ef158fa0e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:36.562333 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f187b9f1-894b-4b63-b16a-7d6ef158fa0e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:36.564090 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f187b9f1-894b-4b63-b16a-7d6ef158fa0e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:36.565181 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f187b9f1-894b-4b63-b16a-7d6ef158fa0e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:36.565729 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f187b9f1-894b-4b63-b16a-7d6ef158fa0e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:36.566193 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f187b9f1-894b-4b63-b16a-7d6ef158fa0e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:36.626422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f187b9f1-894b-4b63-b16a-7d6ef158fa0e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:36.626928 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f187b9f1-894b-4b63-b16a-7d6ef158fa0e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:36.627367 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f187b9f1-894b-4b63-b16a-7d6ef158fa0e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:36.627839 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-f187b9f1-894b-4b63-b16a-7d6ef158fa0e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lazy-loading 'fault' on Instance uuid 4cdde8bf-31af-4304-8f4e-025156ca51db {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:50:36.679189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f187b9f1-894b-4b63-b16a-7d6ef158fa0e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5fcd46b400942a99dafdba6327ba49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a384a5f96e488fb3c4abd75fd876fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:36.689198 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-f187b9f1-894b-4b63-b16a-7d6ef158fa0e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 200 len: 1351 microversion: 2.1 time: 0.139670 Aug 24 17:50:36.689801 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 96/201] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:36 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 1351 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:37.711525 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-211e3d4d-14fd-4af4-8475-898ca8375642 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:37.712226 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-211e3d4d-14fd-4af4-8475-898ca8375642 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:37.718611 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-211e3d4d-14fd-4af4-8475-898ca8375642 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:37.719573 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-211e3d4d-14fd-4af4-8475-898ca8375642 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:37.720137 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-211e3d4d-14fd-4af4-8475-898ca8375642 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:37.721000 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-211e3d4d-14fd-4af4-8475-898ca8375642 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:37.721450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-211e3d4d-14fd-4af4-8475-898ca8375642 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:37.721900 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-211e3d4d-14fd-4af4-8475-898ca8375642 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:37.736440 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-211e3d4d-14fd-4af4-8475-898ca8375642 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] HTTP exception thrown: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-211e3d4d-14fd-4af4-8475-898ca8375642 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Request method failure captured: Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db HTTP/1.1 Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmSbVqd5cMS2dyTRJ9tJyIoxum4EN7MIX93X9xkEdZ_GX-VHgL1it24G6UuGvV_m6_tnA_JMcCo79BmcLuuhnSSa_w_mWawGiM7sd4-5DHIYhmLoznOp5NTnSpjfwgiPyh-oKylPd8GQt3JSzdiIWl67kVG9LtAnsbVdlIjxJp7M2cg Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: b8a384a5f96e488fb3c4abd75fd876fb Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-DeleteServersTestJSON-1351209424 Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:50:37.741082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:50:37.742490 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b8a384a5f96e488fb3c4abd75fd876fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b8a384a5f96e488fb3c4abd75fd876fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b8a384a5f96e488fb3c4abd75fd876fb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b8a384a5f96e488fb3c4abd75fd876fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:50:37.742490 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-DeleteServersTestJSON-1351209424 Aug 24 17:50:37.742490 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: b8a384a5f96e488fb3c4abd75fd876fb Aug 24 17:50:37.742490 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-DeleteServersTestJSON-1351209424 Aug 24 17:50:37.742490 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-DeleteServersTestJSON-1351209424-project Aug 24 17:50:37.742490 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:50:37.742490 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:50:37.742490 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: f5fcd46b400942a99dafdba6327ba49e Aug 24 17:50:37.742490 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-DeleteServersTestJSON-1351209424-project Aug 24 17:50:37.742490 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:50:37.742490 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:37.742490 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': '4cdde8bf-31af-4304-8f4e-025156ca51db'} Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:50:37.743212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:50:37.744400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:50:37.744400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:50:37.744400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:50:37.744400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:50:37.744400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:50:37.744400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:50:37.744400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:50:37.744400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:37.744400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:50:37.744400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:37.744400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:50:37.744400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:37.744400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:37.744400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:37.744400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:50:37.744400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:50:37.744400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:37.744400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:50:37.745478 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-211e3d4d-14fd-4af4-8475-898ca8375642 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Returning 404 to user: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:50:37.745478 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-211e3d4d-14fd-4af4-8475-898ca8375642 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 404 len: 111 microversion: 2.1 time: 0.035371 Aug 24 17:50:37.745478 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 106/202] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:37 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:50:37.874269 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d3bb1c5f-ff01-4845-83e9-510a60a5700e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:37.878119 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d3bb1c5f-ff01-4845-83e9-510a60a5700e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:37.885391 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d3bb1c5f-ff01-4845-83e9-510a60a5700e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:37.885928 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d3bb1c5f-ff01-4845-83e9-510a60a5700e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:37.886441 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d3bb1c5f-ff01-4845-83e9-510a60a5700e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:37.887174 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d3bb1c5f-ff01-4845-83e9-510a60a5700e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:37.888010 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d3bb1c5f-ff01-4845-83e9-510a60a5700e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:37.888769 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d3bb1c5f-ff01-4845-83e9-510a60a5700e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:37.903000 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-d3bb1c5f-ff01-4845-83e9-510a60a5700e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] HTTP exception thrown: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d3bb1c5f-ff01-4845-83e9-510a60a5700e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Request method failure captured: Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db/os-volume_attachments HTTP/1.1 Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmSbVqd5cMS2dyTRJ9tJyIoxum4EN7MIX93X9xkEdZ_GX-VHgL1it24G6UuGvV_m6_tnA_JMcCo79BmcLuuhnSSa_w_mWawGiM7sd4-5DHIYhmLoznOp5NTnSpjfwgiPyh-oKylPd8GQt3JSzdiIWl67kVG9LtAnsbVdlIjxJp7M2cg Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: b8a384a5f96e488fb3c4abd75fd876fb Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-DeleteServersTestJSON-1351209424 Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:50:37.908600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:50:37.917887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b8a384a5f96e488fb3c4abd75fd876fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b8a384a5f96e488fb3c4abd75fd876fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b8a384a5f96e488fb3c4abd75fd876fb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b8a384a5f96e488fb3c4abd75fd876fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:50:37.917887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-DeleteServersTestJSON-1351209424 Aug 24 17:50:37.917887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: b8a384a5f96e488fb3c4abd75fd876fb Aug 24 17:50:37.917887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-DeleteServersTestJSON-1351209424 Aug 24 17:50:37.917887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-DeleteServersTestJSON-1351209424-project Aug 24 17:50:37.917887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:50:37.917887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:50:37.917887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: f5fcd46b400942a99dafdba6327ba49e Aug 24 17:50:37.917887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-DeleteServersTestJSON-1351209424-project Aug 24 17:50:37.917887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:50:37.917887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:37.917887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'server_id': '4cdde8bf-31af-4304-8f4e-025156ca51db'} Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:50:37.918667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:37.919697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:50:37.921018 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d3bb1c5f-ff01-4845-83e9-510a60a5700e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Returning 404 to user: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:50:37.921018 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d3bb1c5f-ff01-4845-83e9-510a60a5700e tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041278 Aug 24 17:50:37.921018 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 97/203] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:50:37 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:50:39.395271 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-297a1850-bce1-4550-a711-80ffc7fddc04 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:39.396531 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-297a1850-bce1-4550-a711-80ffc7fddc04 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:39.403769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-297a1850-bce1-4550-a711-80ffc7fddc04 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:39.406380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-297a1850-bce1-4550-a711-80ffc7fddc04 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:39.406380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-297a1850-bce1-4550-a711-80ffc7fddc04 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:39.406380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-297a1850-bce1-4550-a711-80ffc7fddc04 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:39.406380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-297a1850-bce1-4550-a711-80ffc7fddc04 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:39.408187 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-297a1850-bce1-4550-a711-80ffc7fddc04 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:39.429837 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-297a1850-bce1-4550-a711-80ffc7fddc04 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] HTTP exception thrown: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-297a1850-bce1-4550-a711-80ffc7fddc04 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Request method failure captured: Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: DELETE /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db HTTP/1.1 Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmSbVqd5cMS2dyTRJ9tJyIoxum4EN7MIX93X9xkEdZ_GX-VHgL1it24G6UuGvV_m6_tnA_JMcCo79BmcLuuhnSSa_w_mWawGiM7sd4-5DHIYhmLoznOp5NTnSpjfwgiPyh-oKylPd8GQt3JSzdiIWl67kVG9LtAnsbVdlIjxJp7M2cg Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: b8a384a5f96e488fb3c4abd75fd876fb Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-DeleteServersTestJSON-1351209424 Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:50:39.434938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:50:39.436806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b8a384a5f96e488fb3c4abd75fd876fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b8a384a5f96e488fb3c4abd75fd876fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b8a384a5f96e488fb3c4abd75fd876fb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b8a384a5f96e488fb3c4abd75fd876fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:50:39.436806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-DeleteServersTestJSON-1351209424 Aug 24 17:50:39.436806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: b8a384a5f96e488fb3c4abd75fd876fb Aug 24 17:50:39.436806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-DeleteServersTestJSON-1351209424 Aug 24 17:50:39.436806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-DeleteServersTestJSON-1351209424-project Aug 24 17:50:39.436806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:50:39.436806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:50:39.436806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: f5fcd46b400942a99dafdba6327ba49e Aug 24 17:50:39.436806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-DeleteServersTestJSON-1351209424-project Aug 24 17:50:39.436806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:50:39.436806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:39.436806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': '4cdde8bf-31af-4304-8f4e-025156ca51db'} Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:50:39.437468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:39.438604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:50:39.439797 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-297a1850-bce1-4550-a711-80ffc7fddc04 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Returning 404 to user: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:50:39.439797 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-297a1850-bce1-4550-a711-80ffc7fddc04 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "DELETE /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 404 len: 111 microversion: 2.1 time: 0.042054 Aug 24 17:50:39.439797 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 107/204] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:50:39 2022] DELETE /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:50:39.442743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-987a46bc-6676-4adb-8732-85e7b6618cc8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:39.443943 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-987a46bc-6676-4adb-8732-85e7b6618cc8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] [instance: 4cdde8bf-31af-4304-8f4e-025156ca51db] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:39.451472 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-987a46bc-6676-4adb-8732-85e7b6618cc8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:39.452157 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-987a46bc-6676-4adb-8732-85e7b6618cc8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:39.452746 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-987a46bc-6676-4adb-8732-85e7b6618cc8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:39.454260 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-987a46bc-6676-4adb-8732-85e7b6618cc8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:39.454866 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-987a46bc-6676-4adb-8732-85e7b6618cc8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:39.455428 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-987a46bc-6676-4adb-8732-85e7b6618cc8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:39.473553 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-987a46bc-6676-4adb-8732-85e7b6618cc8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] HTTP exception thrown: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-987a46bc-6676-4adb-8732-85e7b6618cc8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Request method failure captured: Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db HTTP/1.1 Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmSbVqd5cMS2dyTRJ9tJyIoxum4EN7MIX93X9xkEdZ_GX-VHgL1it24G6UuGvV_m6_tnA_JMcCo79BmcLuuhnSSa_w_mWawGiM7sd4-5DHIYhmLoznOp5NTnSpjfwgiPyh-oKylPd8GQt3JSzdiIWl67kVG9LtAnsbVdlIjxJp7M2cg Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: b8a384a5f96e488fb3c4abd75fd876fb Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-DeleteServersTestJSON-1351209424 Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:50:39.476049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:50:39.477444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b8a384a5f96e488fb3c4abd75fd876fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b8a384a5f96e488fb3c4abd75fd876fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b8a384a5f96e488fb3c4abd75fd876fb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b8a384a5f96e488fb3c4abd75fd876fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:50:39.477444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-DeleteServersTestJSON-1351209424 Aug 24 17:50:39.477444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: b8a384a5f96e488fb3c4abd75fd876fb Aug 24 17:50:39.477444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-DeleteServersTestJSON-1351209424 Aug 24 17:50:39.477444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-DeleteServersTestJSON-1351209424-project Aug 24 17:50:39.477444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:50:39.477444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:50:39.477444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: f5fcd46b400942a99dafdba6327ba49e Aug 24 17:50:39.477444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-DeleteServersTestJSON-1351209424-project Aug 24 17:50:39.477444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:50:39.477444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:39.477444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': '4cdde8bf-31af-4304-8f4e-025156ca51db'} Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:50:39.478272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:50:39.479549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:50:39.479549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:50:39.479549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:50:39.479549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:50:39.479549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:50:39.479549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:50:39.479549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:50:39.479549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:39.479549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:50:39.479549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:39.479549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:50:39.479549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:39.479549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:39.479549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:39.479549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:50:39.479549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:50:39.479549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. Aug 24 17:50:39.479549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:50:39.481622 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-987a46bc-6676-4adb-8732-85e7b6618cc8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] Returning 404 to user: Instance 4cdde8bf-31af-4304-8f4e-025156ca51db could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:50:39.482745 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-987a46bc-6676-4adb-8732-85e7b6618cc8 tempest-DeleteServersTestJSON-1351209424 tempest-DeleteServersTestJSON-1351209424-project] 10.222.0.76 "GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db" status: 404 len: 111 microversion: 2.1 time: 0.044894 Aug 24 17:50:39.490157 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 98/205] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:39 2022] GET /compute/v2.1/servers/4cdde8bf-31af-4304-8f4e-025156ca51db => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:50:54.203723 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=12 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:54.204808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=24 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:54.382977 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-6ab34547-ecfd-45df-84d4-b37722529e4d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-235387839", "imageRef": "2d76d745-abc6-4a7b-b8d7-46566b66934b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:54.474632 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.network.neutron [None req-6ab34547-ecfd-45df-84d4-b37722529e4d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] validate_networks() for [('4dda7a94-775b-4143-b064-79a1f63c7c32', None, None, None, None, None)] {{(pid=127676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:50:54.955842 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-6ab34547-ecfd-45df-84d4-b37722529e4d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Flavor limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:50:54.956528 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-6ab34547-ecfd-45df-84d4-b37722529e4d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Image limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:50:54.957153 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-6ab34547-ecfd-45df-84d4-b37722529e4d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Flavor pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:50:54.957710 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-6ab34547-ecfd-45df-84d4-b37722529e4d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Image pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:50:54.958304 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-6ab34547-ecfd-45df-84d4-b37722529e4d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:50:54.976752 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6ab34547-ecfd-45df-84d4-b37722529e4d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:54.976752 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6ab34547-ecfd-45df-84d4-b37722529e4d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:54.977119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6ab34547-ecfd-45df-84d4-b37722529e4d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:54.978025 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6ab34547-ecfd-45df-84d4-b37722529e4d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:54.978441 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6ab34547-ecfd-45df-84d4-b37722529e4d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:54.978818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6ab34547-ecfd-45df-84d4-b37722529e4d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:54.999879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-6ab34547-ecfd-45df-84d4-b37722529e4d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Getting quotas for project 151e9d2b290047e8acd9468c721b9dd3. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:50:55.004864 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-6ab34547-ecfd-45df-84d4-b37722529e4d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Getting quotas for user 63ff0ea67ee64e14aafc5c51cad9684f and project 151e9d2b290047e8acd9468c721b9dd3. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:50:55.027469 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-6ab34547-ecfd-45df-84d4-b37722529e4d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Going to run 1 instances... {{(pid=127676) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:50:55.030475 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-6ab34547-ecfd-45df-84d4-b37722529e4d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d76d745-abc6-4a7b-b8d7-46566b66934b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:50:55.248901 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-6ab34547-ecfd-45df-84d4-b37722529e4d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.050524 Aug 24 17:50:55.256145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 108/206] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 17:50:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:50:55.265577 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-470d41bc-026a-449b-81ce-8dd389d24e07 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:55.266660 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-470d41bc-026a-449b-81ce-8dd389d24e07 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:55.273840 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:55.274992 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:55.365740 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-470d41bc-026a-449b-81ce-8dd389d24e07 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:55.378954 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-470d41bc-026a-449b-81ce-8dd389d24e07 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1221 microversion: 2.1 time: 0.116427 Aug 24 17:50:55.378954 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 99/207] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:55 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1221 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:55.542993 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7b97d632-968d-4115-bfb3-11fa4518a578 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-569945385", "imageRef": "2d76d745-abc6-4a7b-b8d7-46566b66934b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:55.630201 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.network.neutron [None req-7b97d632-968d-4115-bfb3-11fa4518a578 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] validate_networks() for [('4dda7a94-775b-4143-b064-79a1f63c7c32', None, None, None, None, None)] {{(pid=127676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:50:56.251422 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-7b97d632-968d-4115-bfb3-11fa4518a578 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Flavor limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:50:56.252657 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-7b97d632-968d-4115-bfb3-11fa4518a578 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Image limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:50:56.257830 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-7b97d632-968d-4115-bfb3-11fa4518a578 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Flavor pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:50:56.258585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-7b97d632-968d-4115-bfb3-11fa4518a578 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Image pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:50:56.259015 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-7b97d632-968d-4115-bfb3-11fa4518a578 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:50:56.272990 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7b97d632-968d-4115-bfb3-11fa4518a578 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:56.273493 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7b97d632-968d-4115-bfb3-11fa4518a578 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:56.273967 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7b97d632-968d-4115-bfb3-11fa4518a578 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:56.274765 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7b97d632-968d-4115-bfb3-11fa4518a578 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:56.275238 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7b97d632-968d-4115-bfb3-11fa4518a578 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:56.275680 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7b97d632-968d-4115-bfb3-11fa4518a578 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:56.298061 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-7b97d632-968d-4115-bfb3-11fa4518a578 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Getting quotas for project 151e9d2b290047e8acd9468c721b9dd3. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:50:56.301370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-7b97d632-968d-4115-bfb3-11fa4518a578 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Getting quotas for user 63ff0ea67ee64e14aafc5c51cad9684f and project 151e9d2b290047e8acd9468c721b9dd3. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:50:56.314715 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7b97d632-968d-4115-bfb3-11fa4518a578 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Going to run 1 instances... {{(pid=127676) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:50:56.317037 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7b97d632-968d-4115-bfb3-11fa4518a578 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d76d745-abc6-4a7b-b8d7-46566b66934b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:50:56.460014 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7b97d632-968d-4115-bfb3-11fa4518a578 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.920811 Aug 24 17:50:56.461222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 109/208] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 17:50:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:50:56.473545 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e0d5968e-3e4b-4f4c-9e45-f782d002f358 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:56.474470 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-e0d5968e-3e4b-4f4c-9e45-f782d002f358 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:56.580251 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e0d5968e-3e4b-4f4c-9e45-f782d002f358 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:56.597728 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-e0d5968e-3e4b-4f4c-9e45-f782d002f358 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1221 microversion: 2.1 time: 0.128335 Aug 24 17:50:56.598355 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 100/209] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:56 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1221 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:57.623554 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b21a071a-0f49-4b88-b8fc-083c6aef24b9 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:57.624220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-b21a071a-0f49-4b88-b8fc-083c6aef24b9 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:57.693573 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b21a071a-0f49-4b88-b8fc-083c6aef24b9 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:57.720191 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b21a071a-0f49-4b88-b8fc-083c6aef24b9 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1221 microversion: 2.1 time: 0.098860 Aug 24 17:50:57.723613 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 110/210] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:57 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1221 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:58.747417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4bcf6e6e-e0d6-426a-8be9-8faea7866c43 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:58.748220 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4bcf6e6e-e0d6-426a-8be9-8faea7866c43 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:58.775533 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4bcf6e6e-e0d6-426a-8be9-8faea7866c43 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:58.795182 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4bcf6e6e-e0d6-426a-8be9-8faea7866c43 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:58.795705 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4bcf6e6e-e0d6-426a-8be9-8faea7866c43 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:58.814487 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4bcf6e6e-e0d6-426a-8be9-8faea7866c43 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:58.815646 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4bcf6e6e-e0d6-426a-8be9-8faea7866c43 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:58.816461 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4bcf6e6e-e0d6-426a-8be9-8faea7866c43 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:58.911153 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-4bcf6e6e-e0d6-426a-8be9-8faea7866c43 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:58.920727 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-4bcf6e6e-e0d6-426a-8be9-8faea7866c43 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1217 microversion: 2.1 time: 0.177093 Aug 24 17:50:58.925252 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 101/211] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:58 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1217 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:59.952223 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-339333c5-ae7a-40ed-8b48-b54edcb31132 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:59.954293 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-339333c5-ae7a-40ed-8b48-b54edcb31132 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:59.961977 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-339333c5-ae7a-40ed-8b48-b54edcb31132 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:59.962471 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-339333c5-ae7a-40ed-8b48-b54edcb31132 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:59.962904 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-339333c5-ae7a-40ed-8b48-b54edcb31132 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:59.963603 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-339333c5-ae7a-40ed-8b48-b54edcb31132 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:59.964054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-339333c5-ae7a-40ed-8b48-b54edcb31132 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:59.964478 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-339333c5-ae7a-40ed-8b48-b54edcb31132 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:00.047573 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-339333c5-ae7a-40ed-8b48-b54edcb31132 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:00.061062 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-339333c5-ae7a-40ed-8b48-b54edcb31132 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1281 microversion: 2.1 time: 0.112875 Aug 24 17:51:00.062840 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 111/212] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:59 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1281 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:00.890810 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ee85a41a-0548-4f29-b65e-36a6319cb89c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:00.892085 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ee85a41a-0548-4f29-b65e-36a6319cb89c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:00.899582 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee85a41a-0548-4f29-b65e-36a6319cb89c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:00.900465 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee85a41a-0548-4f29-b65e-36a6319cb89c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:00.901117 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee85a41a-0548-4f29-b65e-36a6319cb89c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:00.902105 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee85a41a-0548-4f29-b65e-36a6319cb89c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:00.934420 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee85a41a-0548-4f29-b65e-36a6319cb89c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:00.935225 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee85a41a-0548-4f29-b65e-36a6319cb89c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:00.965733 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ee85a41a-0548-4f29-b65e-36a6319cb89c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/ips" status: 200 len: 151 microversion: 2.20 time: 0.078802 Aug 24 17:51:00.966508 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 102/213] 10.222.0.76 () {60 vars in 1289 bytes} [Wed Aug 24 17:51:00 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/ips => generated 151 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:51:01.084027 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-3a595e31-3fd7-4867-99a9-5c76f4edfcca tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:01.084651 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-3a595e31-3fd7-4867-99a9-5c76f4edfcca tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:01.090841 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3a595e31-3fd7-4867-99a9-5c76f4edfcca tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:01.091861 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3a595e31-3fd7-4867-99a9-5c76f4edfcca tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:01.092641 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3a595e31-3fd7-4867-99a9-5c76f4edfcca tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:01.093678 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3a595e31-3fd7-4867-99a9-5c76f4edfcca tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:01.094414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3a595e31-3fd7-4867-99a9-5c76f4edfcca tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:01.095068 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3a595e31-3fd7-4867-99a9-5c76f4edfcca tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:01.193087 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-3a595e31-3fd7-4867-99a9-5c76f4edfcca tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:01.203866 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-3a595e31-3fd7-4867-99a9-5c76f4edfcca tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1279 microversion: 2.1 time: 0.123445 Aug 24 17:51:01.204766 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 112/214] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:01 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1279 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:02.224874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d38f4931-a7c1-419b-a213-07d5b3552785 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:02.225327 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d38f4931-a7c1-419b-a213-07d5b3552785 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:02.231937 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d38f4931-a7c1-419b-a213-07d5b3552785 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:02.232422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d38f4931-a7c1-419b-a213-07d5b3552785 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:02.232856 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d38f4931-a7c1-419b-a213-07d5b3552785 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:02.234803 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d38f4931-a7c1-419b-a213-07d5b3552785 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:02.235380 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d38f4931-a7c1-419b-a213-07d5b3552785 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:02.235894 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d38f4931-a7c1-419b-a213-07d5b3552785 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:02.417568 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d38f4931-a7c1-419b-a213-07d5b3552785 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:02.434792 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d38f4931-a7c1-419b-a213-07d5b3552785 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1321 microversion: 2.1 time: 0.211031 Aug 24 17:51:02.450026 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 103/215] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:02 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:02.659797 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-c8a5bbca-c392-457c-9f11-b479718a8a25 req-064fad4b-efa1-40c7-9151-238239953df1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec18342-3f45-401f-ba1a-768a427a5fa2", "tag": "565c8009-6ae5-4c23-a533-fff7bf8e849d"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:02.671925 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-c8a5bbca-c392-457c-9f11-b479718a8a25 req-064fad4b-efa1-40c7-9151-238239953df1 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:02.672733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-c8a5bbca-c392-457c-9f11-b479718a8a25 req-064fad4b-efa1-40c7-9151-238239953df1 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:02.673274 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-c8a5bbca-c392-457c-9f11-b479718a8a25 req-064fad4b-efa1-40c7-9151-238239953df1 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:02.688060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-c8a5bbca-c392-457c-9f11-b479718a8a25 req-064fad4b-efa1-40c7-9151-238239953df1 service nova] Creating event network-changed:565c8009-6ae5-4c23-a533-fff7bf8e849d for instance 4ec18342-3f45-401f-ba1a-768a427a5fa2 on hv-cinder-85442 Aug 24 17:51:02.693177 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-c8a5bbca-c392-457c-9f11-b479718a8a25 req-064fad4b-efa1-40c7-9151-238239953df1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038759 Aug 24 17:51:02.693786 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 113/216] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:03.457996 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1a86e64e-a0ff-43e2-83fb-dd6fc11adc77 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:03.459355 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1a86e64e-a0ff-43e2-83fb-dd6fc11adc77 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:03.481388 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1a86e64e-a0ff-43e2-83fb-dd6fc11adc77 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:03.482328 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1a86e64e-a0ff-43e2-83fb-dd6fc11adc77 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:03.495423 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1a86e64e-a0ff-43e2-83fb-dd6fc11adc77 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:03.500294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1a86e64e-a0ff-43e2-83fb-dd6fc11adc77 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:03.501522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1a86e64e-a0ff-43e2-83fb-dd6fc11adc77 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:03.502832 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1a86e64e-a0ff-43e2-83fb-dd6fc11adc77 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:03.728497 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1a86e64e-a0ff-43e2-83fb-dd6fc11adc77 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:03.737901 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1a86e64e-a0ff-43e2-83fb-dd6fc11adc77 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1321 microversion: 2.1 time: 0.285143 Aug 24 17:51:03.738798 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 104/217] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:03 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:04.453989 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-69928715-6332-4fb4-af06-1614f00c5c0d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:04.454614 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-69928715-6332-4fb4-af06-1614f00c5c0d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:04.461170 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69928715-6332-4fb4-af06-1614f00c5c0d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:04.461645 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69928715-6332-4fb4-af06-1614f00c5c0d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:04.462102 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69928715-6332-4fb4-af06-1614f00c5c0d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:04.462842 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69928715-6332-4fb4-af06-1614f00c5c0d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:04.463291 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69928715-6332-4fb4-af06-1614f00c5c0d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:04.463710 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69928715-6332-4fb4-af06-1614f00c5c0d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:04.489188 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-69928715-6332-4fb4-af06-1614f00c5c0d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lazy-loading 'flavor' on Instance uuid 154f9aac-b081-4041-ba41-dd14fb267e29 {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:51:04.647648 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-184c722a-86a7-4ac3-9c88-e50ac418ac7c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:04.648621 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-184c722a-86a7-4ac3-9c88-e50ac418ac7c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:04.655367 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-184c722a-86a7-4ac3-9c88-e50ac418ac7c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:04.655864 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-184c722a-86a7-4ac3-9c88-e50ac418ac7c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:04.656349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-184c722a-86a7-4ac3-9c88-e50ac418ac7c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:04.657218 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-184c722a-86a7-4ac3-9c88-e50ac418ac7c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:04.657837 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-184c722a-86a7-4ac3-9c88-e50ac418ac7c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:04.658836 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-184c722a-86a7-4ac3-9c88-e50ac418ac7c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:04.683519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-184c722a-86a7-4ac3-9c88-e50ac418ac7c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/ips" status: 200 len: 150 microversion: 2.1 time: 0.043306 Aug 24 17:51:04.684101 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 105/218] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 24 17:51:04 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:51:04.710636 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-de970522-c39c-411d-9219-94380420735a req-46f88780-057d-4f9f-8306-fe16866380c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1deb7e5-c813-4c8b-829e-3c38e10fde3b", "tag": "cc4b347c-0dc2-4c02-b53f-f642a08163d3"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:04.721173 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-de970522-c39c-411d-9219-94380420735a req-46f88780-057d-4f9f-8306-fe16866380c2 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:04.721725 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-de970522-c39c-411d-9219-94380420735a req-46f88780-057d-4f9f-8306-fe16866380c2 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:04.722181 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-de970522-c39c-411d-9219-94380420735a req-46f88780-057d-4f9f-8306-fe16866380c2 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:04.743000 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-de970522-c39c-411d-9219-94380420735a req-46f88780-057d-4f9f-8306-fe16866380c2 service nova] Creating event network-changed:cc4b347c-0dc2-4c02-b53f-f642a08163d3 for instance e1deb7e5-c813-4c8b-829e-3c38e10fde3b on hv-cinder-85442 Aug 24 17:51:04.751040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-de970522-c39c-411d-9219-94380420735a req-46f88780-057d-4f9f-8306-fe16866380c2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046550 Aug 24 17:51:04.756025 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 106/219] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:51:04.762307 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c7ebbe24-9c0c-4b1b-9086-b5425836ee85 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:04.763271 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c7ebbe24-9c0c-4b1b-9086-b5425836ee85 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:04.771159 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c7ebbe24-9c0c-4b1b-9086-b5425836ee85 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:04.771648 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c7ebbe24-9c0c-4b1b-9086-b5425836ee85 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:04.772290 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c7ebbe24-9c0c-4b1b-9086-b5425836ee85 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:04.773240 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c7ebbe24-9c0c-4b1b-9086-b5425836ee85 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:04.773873 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c7ebbe24-9c0c-4b1b-9086-b5425836ee85 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:04.774456 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c7ebbe24-9c0c-4b1b-9086-b5425836ee85 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:04.943606 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c7ebbe24-9c0c-4b1b-9086-b5425836ee85 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:04.951699 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c7ebbe24-9c0c-4b1b-9086-b5425836ee85 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1321 microversion: 2.1 time: 0.193711 Aug 24 17:51:04.952934 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 107/220] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:04 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:05.054012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-69928715-6332-4fb4-af06-1614f00c5c0d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "POST /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/action" status: 202 len: 0 microversion: 2.20 time: 0.605548 Aug 24 17:51:05.054545 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 114/221] 10.222.0.76 () {62 vars in 1319 bytes} [Wed Aug 24 17:51:04 2022] POST /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:51:05.062870 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-8aa5ac99-c979-49e8-9c1a-977a1d170538 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:05.068629 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-8aa5ac99-c979-49e8-9c1a-977a1d170538 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:05.069486 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8aa5ac99-c979-49e8-9c1a-977a1d170538 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:05.070014 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8aa5ac99-c979-49e8-9c1a-977a1d170538 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:05.070451 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8aa5ac99-c979-49e8-9c1a-977a1d170538 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:05.071143 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8aa5ac99-c979-49e8-9c1a-977a1d170538 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:05.071597 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8aa5ac99-c979-49e8-9c1a-977a1d170538 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:05.072018 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8aa5ac99-c979-49e8-9c1a-977a1d170538 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:05.221350 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-8aa5ac99-c979-49e8-9c1a-977a1d170538 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:05.235336 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-8aa5ac99-c979-49e8-9c1a-977a1d170538 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:05.238404 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-8aa5ac99-c979-49e8-9c1a-977a1d170538 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:05.240628 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-8aa5ac99-c979-49e8-9c1a-977a1d170538 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.181376 Aug 24 17:51:05.241676 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 108/222] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:05 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:05.818160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-505d7bbb-e5b2-4805-ba7d-50e756cd8cb0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:05.820152 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-505d7bbb-e5b2-4805-ba7d-50e756cd8cb0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:05.827825 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-505d7bbb-e5b2-4805-ba7d-50e756cd8cb0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:05.828640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-505d7bbb-e5b2-4805-ba7d-50e756cd8cb0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:05.829226 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-505d7bbb-e5b2-4805-ba7d-50e756cd8cb0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:05.830137 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-505d7bbb-e5b2-4805-ba7d-50e756cd8cb0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:05.830694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-505d7bbb-e5b2-4805-ba7d-50e756cd8cb0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:05.831215 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-505d7bbb-e5b2-4805-ba7d-50e756cd8cb0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:05.860163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-505d7bbb-e5b2-4805-ba7d-50e756cd8cb0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f/ips" status: 200 len: 146 microversion: 2.1 time: 0.049815 Aug 24 17:51:05.860768 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 115/223] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 24 17:51:05 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f/ips => generated 146 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:05.974182 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-6be804b7-e009-4192-8f41-7016e491e863 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:05.976974 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-6be804b7-e009-4192-8f41-7016e491e863 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:05.982045 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6be804b7-e009-4192-8f41-7016e491e863 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:05.982867 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6be804b7-e009-4192-8f41-7016e491e863 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:05.983884 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6be804b7-e009-4192-8f41-7016e491e863 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:05.984820 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6be804b7-e009-4192-8f41-7016e491e863 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:05.985259 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6be804b7-e009-4192-8f41-7016e491e863 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:05.985888 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6be804b7-e009-4192-8f41-7016e491e863 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:06.176460 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-6be804b7-e009-4192-8f41-7016e491e863 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:06.185748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-6be804b7-e009-4192-8f41-7016e491e863 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1321 microversion: 2.1 time: 0.215437 Aug 24 17:51:06.187656 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 109/224] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:05 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:06.268324 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8fd5643b-c405-4ade-b66b-33e9277231d6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:06.269926 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8fd5643b-c405-4ade-b66b-33e9277231d6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:06.285293 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=4 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:06.287993 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8fd5643b-c405-4ade-b66b-33e9277231d6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:06.288864 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8fd5643b-c405-4ade-b66b-33e9277231d6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:06.289309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8fd5643b-c405-4ade-b66b-33e9277231d6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:06.290073 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8fd5643b-c405-4ade-b66b-33e9277231d6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:06.290857 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8fd5643b-c405-4ade-b66b-33e9277231d6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:06.291350 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8fd5643b-c405-4ade-b66b-33e9277231d6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:06.440947 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8fd5643b-c405-4ade-b66b-33e9277231d6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:06.450308 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8fd5643b-c405-4ade-b66b-33e9277231d6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:06.452818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8fd5643b-c405-4ade-b66b-33e9277231d6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:06.453915 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-8fd5643b-c405-4ade-b66b-33e9277231d6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.192455 Aug 24 17:51:06.454523 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 116/225] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:06 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:06.586694 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e75a7ef4-2794-4026-b787-f23d588362d2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b267c041-ab30-43cd-9d46-5b63aab4e10d"}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:06.589221 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-e75a7ef4-2794-4026-b787-f23d588362d2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:06.592342 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=4 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:06.596001 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e75a7ef4-2794-4026-b787-f23d588362d2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:06.596494 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e75a7ef4-2794-4026-b787-f23d588362d2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:06.596937 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e75a7ef4-2794-4026-b787-f23d588362d2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:06.597634 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e75a7ef4-2794-4026-b787-f23d588362d2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:06.598126 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e75a7ef4-2794-4026-b787-f23d588362d2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:06.598556 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e75a7ef4-2794-4026-b787-f23d588362d2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:07.212321 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-57eeb5de-d150-4d96-8635-2f4dfe10eeee tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:07.212985 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-57eeb5de-d150-4d96-8635-2f4dfe10eeee tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:07.220844 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57eeb5de-d150-4d96-8635-2f4dfe10eeee tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:07.221336 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57eeb5de-d150-4d96-8635-2f4dfe10eeee tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:07.225285 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57eeb5de-d150-4d96-8635-2f4dfe10eeee tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:07.225285 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57eeb5de-d150-4d96-8635-2f4dfe10eeee tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:07.225572 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57eeb5de-d150-4d96-8635-2f4dfe10eeee tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:07.226392 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57eeb5de-d150-4d96-8635-2f4dfe10eeee tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:07.391670 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-57eeb5de-d150-4d96-8635-2f4dfe10eeee tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:07.409532 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-57eeb5de-d150-4d96-8635-2f4dfe10eeee tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1321 microversion: 2.1 time: 0.201413 Aug 24 17:51:07.414518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 117/226] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:07 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:07.481023 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a589e8c5-7809-4708-a229-1a7dbf9afa76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:07.481940 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a589e8c5-7809-4708-a229-1a7dbf9afa76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:07.489583 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a589e8c5-7809-4708-a229-1a7dbf9afa76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:07.490115 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a589e8c5-7809-4708-a229-1a7dbf9afa76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:07.490625 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a589e8c5-7809-4708-a229-1a7dbf9afa76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:07.491540 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a589e8c5-7809-4708-a229-1a7dbf9afa76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:07.492166 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a589e8c5-7809-4708-a229-1a7dbf9afa76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:07.492600 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a589e8c5-7809-4708-a229-1a7dbf9afa76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:07.653585 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-e75a7ef4-2794-4026-b787-f23d588362d2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "POST /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.070066 Aug 24 17:51:07.661645 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 110/227] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 17:51:06 2022] POST /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments => generated 194 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:07.718361 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=14 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:07.722370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a589e8c5-7809-4708-a229-1a7dbf9afa76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:07.733175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a589e8c5-7809-4708-a229-1a7dbf9afa76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:07.735434 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a589e8c5-7809-4708-a229-1a7dbf9afa76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:07.737596 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a589e8c5-7809-4708-a229-1a7dbf9afa76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.262886 Aug 24 17:51:07.757826 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 118/228] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:07 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:08.431535 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9c17f2e1-9fa3-4187-83bd-480c6bd6dab3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:08.432505 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9c17f2e1-9fa3-4187-83bd-480c6bd6dab3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:08.444647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9c17f2e1-9fa3-4187-83bd-480c6bd6dab3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:08.444647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9c17f2e1-9fa3-4187-83bd-480c6bd6dab3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:08.444647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9c17f2e1-9fa3-4187-83bd-480c6bd6dab3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:08.445796 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9c17f2e1-9fa3-4187-83bd-480c6bd6dab3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:08.447119 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9c17f2e1-9fa3-4187-83bd-480c6bd6dab3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:08.447992 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9c17f2e1-9fa3-4187-83bd-480c6bd6dab3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:08.594202 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9c17f2e1-9fa3-4187-83bd-480c6bd6dab3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:08.602348 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9c17f2e1-9fa3-4187-83bd-480c6bd6dab3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1321 microversion: 2.1 time: 0.174886 Aug 24 17:51:08.602916 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 111/229] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:08 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:08.766129 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f176aff5-364c-440d-b406-d64d5bf953f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:08.766739 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f176aff5-364c-440d-b406-d64d5bf953f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:08.773022 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f176aff5-364c-440d-b406-d64d5bf953f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:08.773600 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f176aff5-364c-440d-b406-d64d5bf953f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:08.774162 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f176aff5-364c-440d-b406-d64d5bf953f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:08.774852 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f176aff5-364c-440d-b406-d64d5bf953f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:08.775306 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f176aff5-364c-440d-b406-d64d5bf953f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:08.775799 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f176aff5-364c-440d-b406-d64d5bf953f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:08.949181 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f176aff5-364c-440d-b406-d64d5bf953f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:08.973138 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f176aff5-364c-440d-b406-d64d5bf953f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:08.982671 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f176aff5-364c-440d-b406-d64d5bf953f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:08.982671 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f176aff5-364c-440d-b406-d64d5bf953f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.215116 Aug 24 17:51:08.982671 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 119/230] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:08 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:09.562458 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-5f294c49-af27-4cb6-a634-41d9ed357bba req-f3cad4f8-64c4-4238-85fb-cf280867706e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec18342-3f45-401f-ba1a-768a427a5fa2", "name": "network-vif-plugged", "status": "completed", "tag": "565c8009-6ae5-4c23-a533-fff7bf8e849d"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:09.572636 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-5f294c49-af27-4cb6-a634-41d9ed357bba req-f3cad4f8-64c4-4238-85fb-cf280867706e service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:09.577394 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-5f294c49-af27-4cb6-a634-41d9ed357bba req-f3cad4f8-64c4-4238-85fb-cf280867706e service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:09.577394 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-5f294c49-af27-4cb6-a634-41d9ed357bba req-f3cad4f8-64c4-4238-85fb-cf280867706e service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:09.584961 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-5f294c49-af27-4cb6-a634-41d9ed357bba req-f3cad4f8-64c4-4238-85fb-cf280867706e service nova] Creating event network-vif-plugged:565c8009-6ae5-4c23-a533-fff7bf8e849d for instance 4ec18342-3f45-401f-ba1a-768a427a5fa2 on hv-cinder-85442 Aug 24 17:51:09.590100 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-5f294c49-af27-4cb6-a634-41d9ed357bba req-f3cad4f8-64c4-4238-85fb-cf280867706e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032229 Aug 24 17:51:09.590745 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 112/231] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:09.629840 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ddb45d9c-c84c-4945-a7fd-679bfb7619f3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:09.631331 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-ddb45d9c-c84c-4945-a7fd-679bfb7619f3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:09.642469 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ddb45d9c-c84c-4945-a7fd-679bfb7619f3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:09.643368 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ddb45d9c-c84c-4945-a7fd-679bfb7619f3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:09.644172 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ddb45d9c-c84c-4945-a7fd-679bfb7619f3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:09.645610 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ddb45d9c-c84c-4945-a7fd-679bfb7619f3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:09.646476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ddb45d9c-c84c-4945-a7fd-679bfb7619f3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:09.647258 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ddb45d9c-c84c-4945-a7fd-679bfb7619f3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:09.820902 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-ddb45d9c-c84c-4945-a7fd-679bfb7619f3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:09.829338 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-ddb45d9c-c84c-4945-a7fd-679bfb7619f3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1321 microversion: 2.1 time: 0.208210 Aug 24 17:51:09.829956 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 120/232] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:09 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:09.919308 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-59c0f93a-e91a-4f36-b4a3-308ce6265bdc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3299462-4a0a-4df4-a1f0-cf7c5a51e668"}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:09.922529 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-59c0f93a-e91a-4f36-b4a3-308ce6265bdc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:09.931073 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-59c0f93a-e91a-4f36-b4a3-308ce6265bdc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:09.931574 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-59c0f93a-e91a-4f36-b4a3-308ce6265bdc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:09.932010 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-59c0f93a-e91a-4f36-b4a3-308ce6265bdc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:09.932711 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-59c0f93a-e91a-4f36-b4a3-308ce6265bdc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:09.933158 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-59c0f93a-e91a-4f36-b4a3-308ce6265bdc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:09.933580 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-59c0f93a-e91a-4f36-b4a3-308ce6265bdc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:10.005468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d870855c-2a38-4bb2-9ff2-81de3074d5e9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:10.006208 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d870855c-2a38-4bb2-9ff2-81de3074d5e9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:10.017813 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d870855c-2a38-4bb2-9ff2-81de3074d5e9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:10.018951 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d870855c-2a38-4bb2-9ff2-81de3074d5e9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:10.019762 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d870855c-2a38-4bb2-9ff2-81de3074d5e9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:10.025027 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d870855c-2a38-4bb2-9ff2-81de3074d5e9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:10.025533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d870855c-2a38-4bb2-9ff2-81de3074d5e9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:10.026006 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d870855c-2a38-4bb2-9ff2-81de3074d5e9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:10.193458 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d870855c-2a38-4bb2-9ff2-81de3074d5e9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:10.203164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d870855c-2a38-4bb2-9ff2-81de3074d5e9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:10.204165 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d870855c-2a38-4bb2-9ff2-81de3074d5e9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:10.205307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d870855c-2a38-4bb2-9ff2-81de3074d5e9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.204293 Aug 24 17:51:10.205884 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 121/233] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:09 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:51:10.210209 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-684767d6-d83d-47b7-aea1-29a1ddcaf2c5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-874927583", "imageRef": "2d76d745-abc6-4a7b-b8d7-46566b66934b", "flavorRef": "452"}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:10.263533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.network.neutron [None req-684767d6-d83d-47b7-aea1-29a1ddcaf2c5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] validate_networks() for None {{(pid=127676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:51:10.556611 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-684767d6-d83d-47b7-aea1-29a1ddcaf2c5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Flavor limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:51:10.557034 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-684767d6-d83d-47b7-aea1-29a1ddcaf2c5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Image limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:51:10.557509 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-684767d6-d83d-47b7-aea1-29a1ddcaf2c5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Flavor pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:51:10.557956 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-684767d6-d83d-47b7-aea1-29a1ddcaf2c5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Image pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:51:10.558377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-684767d6-d83d-47b7-aea1-29a1ddcaf2c5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:51:10.568039 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-684767d6-d83d-47b7-aea1-29a1ddcaf2c5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:10.568584 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-684767d6-d83d-47b7-aea1-29a1ddcaf2c5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:10.569020 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-684767d6-d83d-47b7-aea1-29a1ddcaf2c5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:10.569749 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-684767d6-d83d-47b7-aea1-29a1ddcaf2c5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:10.570235 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-684767d6-d83d-47b7-aea1-29a1ddcaf2c5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:10.570694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-684767d6-d83d-47b7-aea1-29a1ddcaf2c5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:10.588501 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-684767d6-d83d-47b7-aea1-29a1ddcaf2c5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Getting quotas for project a770f0caef364853a4033422b76ab918. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:51:10.592546 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-684767d6-d83d-47b7-aea1-29a1ddcaf2c5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Getting quotas for user bfdf1fd67f954cde9ad1334bb93ec4e6 and project a770f0caef364853a4033422b76ab918. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:51:10.603712 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-684767d6-d83d-47b7-aea1-29a1ddcaf2c5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Going to run 1 instances... {{(pid=127676) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:51:10.606270 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-684767d6-d83d-47b7-aea1-29a1ddcaf2c5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d76d745-abc6-4a7b-b8d7-46566b66934b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:51:10.827497 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-684767d6-d83d-47b7-aea1-29a1ddcaf2c5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619955 Aug 24 17:51:10.828264 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 122/234] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 17:51:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:51:10.845129 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ba114806-2ddc-47c3-99eb-ebcaf732158d tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:10.846299 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-ba114806-2ddc-47c3-99eb-ebcaf732158d tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:10.923013 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-ba114806-2ddc-47c3-99eb-ebcaf732158d tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:10.932585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-ba114806-2ddc-47c3-99eb-ebcaf732158d tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1214 microversion: 2.1 time: 0.096647 Aug 24 17:51:10.933464 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 123/235] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:10 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:10.938989 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b76e8851-6a8b-4c52-8f93-3e2f63d62e0a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:10.939572 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-b76e8851-6a8b-4c52-8f93-3e2f63d62e0a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:10.946655 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b76e8851-6a8b-4c52-8f93-3e2f63d62e0a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:10.947184 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b76e8851-6a8b-4c52-8f93-3e2f63d62e0a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:10.947576 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b76e8851-6a8b-4c52-8f93-3e2f63d62e0a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:10.948400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b76e8851-6a8b-4c52-8f93-3e2f63d62e0a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:10.948829 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b76e8851-6a8b-4c52-8f93-3e2f63d62e0a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:10.949306 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b76e8851-6a8b-4c52-8f93-3e2f63d62e0a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:11.103605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b76e8851-6a8b-4c52-8f93-3e2f63d62e0a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:11.117581 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b76e8851-6a8b-4c52-8f93-3e2f63d62e0a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1321 microversion: 2.1 time: 0.182834 Aug 24 17:51:11.118311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 124/236] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:10 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:11.120955 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-59c0f93a-e91a-4f36-b4a3-308ce6265bdc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "POST /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.205884 Aug 24 17:51:11.121564 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 113/237] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 17:51:09 2022] POST /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f/os-volume_attachments => generated 194 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:11.228927 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d3328dbc-68b2-4ccc-8373-df5fcca2839f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:11.229527 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d3328dbc-68b2-4ccc-8373-df5fcca2839f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:11.235937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d3328dbc-68b2-4ccc-8373-df5fcca2839f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:11.236428 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d3328dbc-68b2-4ccc-8373-df5fcca2839f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:11.236858 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d3328dbc-68b2-4ccc-8373-df5fcca2839f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:11.237549 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d3328dbc-68b2-4ccc-8373-df5fcca2839f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:11.238014 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d3328dbc-68b2-4ccc-8373-df5fcca2839f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:11.238430 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d3328dbc-68b2-4ccc-8373-df5fcca2839f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:11.415002 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d3328dbc-68b2-4ccc-8373-df5fcca2839f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:11.423866 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d3328dbc-68b2-4ccc-8373-df5fcca2839f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:11.425385 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d3328dbc-68b2-4ccc-8373-df5fcca2839f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:11.426645 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d3328dbc-68b2-4ccc-8373-df5fcca2839f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.201609 Aug 24 17:51:11.427213 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 125/238] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:11 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:11.727190 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-73e2e370-ec2e-4dc1-ad24-5d7827673433 req-9a55df94-a3a7-4d8c-a6dd-f4d9ebcab60f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1deb7e5-c813-4c8b-829e-3c38e10fde3b", "name": "network-vif-plugged", "status": "completed", "tag": "cc4b347c-0dc2-4c02-b53f-f642a08163d3"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:11.754034 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-73e2e370-ec2e-4dc1-ad24-5d7827673433 req-9a55df94-a3a7-4d8c-a6dd-f4d9ebcab60f service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:11.755047 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-73e2e370-ec2e-4dc1-ad24-5d7827673433 req-9a55df94-a3a7-4d8c-a6dd-f4d9ebcab60f service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:11.755698 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-73e2e370-ec2e-4dc1-ad24-5d7827673433 req-9a55df94-a3a7-4d8c-a6dd-f4d9ebcab60f service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:11.769674 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-73e2e370-ec2e-4dc1-ad24-5d7827673433 req-9a55df94-a3a7-4d8c-a6dd-f4d9ebcab60f service nova] Creating event network-vif-plugged:cc4b347c-0dc2-4c02-b53f-f642a08163d3 for instance e1deb7e5-c813-4c8b-829e-3c38e10fde3b on hv-cinder-85442 Aug 24 17:51:11.775279 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-73e2e370-ec2e-4dc1-ad24-5d7827673433 req-9a55df94-a3a7-4d8c-a6dd-f4d9ebcab60f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059530 Aug 24 17:51:11.775925 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 114/239] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:11.956858 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d790abac-9fb4-4a55-8154-c4a5ce1e6b17 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:11.957495 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d790abac-9fb4-4a55-8154-c4a5ce1e6b17 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:12.019642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d790abac-9fb4-4a55-8154-c4a5ce1e6b17 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:12.032171 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d790abac-9fb4-4a55-8154-c4a5ce1e6b17 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1214 microversion: 2.1 time: 0.077319 Aug 24 17:51:12.032171 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 126/240] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:11 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:12.156682 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c02b2410-11be-44dc-b200-d781c4daab16 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:12.157563 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c02b2410-11be-44dc-b200-d781c4daab16 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:12.164476 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c02b2410-11be-44dc-b200-d781c4daab16 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:12.164964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c02b2410-11be-44dc-b200-d781c4daab16 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:12.165401 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c02b2410-11be-44dc-b200-d781c4daab16 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:12.166123 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c02b2410-11be-44dc-b200-d781c4daab16 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:12.166570 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c02b2410-11be-44dc-b200-d781c4daab16 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:12.167019 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c02b2410-11be-44dc-b200-d781c4daab16 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:12.349294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c02b2410-11be-44dc-b200-d781c4daab16 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:12.363529 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c02b2410-11be-44dc-b200-d781c4daab16 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1321 microversion: 2.1 time: 0.212356 Aug 24 17:51:12.364120 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 115/241] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:12 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:12.450433 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a31f21ed-5d25-49a0-80b4-58e0168b255a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:12.451034 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a31f21ed-5d25-49a0-80b4-58e0168b255a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:12.458369 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a31f21ed-5d25-49a0-80b4-58e0168b255a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:12.458855 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a31f21ed-5d25-49a0-80b4-58e0168b255a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:12.459283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a31f21ed-5d25-49a0-80b4-58e0168b255a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:12.459974 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a31f21ed-5d25-49a0-80b4-58e0168b255a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:12.460425 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a31f21ed-5d25-49a0-80b4-58e0168b255a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:12.460875 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a31f21ed-5d25-49a0-80b4-58e0168b255a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:12.616198 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a31f21ed-5d25-49a0-80b4-58e0168b255a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:12.625742 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a31f21ed-5d25-49a0-80b4-58e0168b255a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:12.627316 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a31f21ed-5d25-49a0-80b4-58e0168b255a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:12.628515 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a31f21ed-5d25-49a0-80b4-58e0168b255a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.182145 Aug 24 17:51:12.629086 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 127/242] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:12 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:13.051184 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f1e52bcb-7e63-432a-a939-2a9f1940f567 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:13.051790 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-f1e52bcb-7e63-432a-a939-2a9f1940f567 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:13.058242 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f1e52bcb-7e63-432a-a939-2a9f1940f567 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:13.058751 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f1e52bcb-7e63-432a-a939-2a9f1940f567 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:13.059147 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f1e52bcb-7e63-432a-a939-2a9f1940f567 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:13.059840 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f1e52bcb-7e63-432a-a939-2a9f1940f567 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:13.060291 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f1e52bcb-7e63-432a-a939-2a9f1940f567 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:13.060706 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f1e52bcb-7e63-432a-a939-2a9f1940f567 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:13.144122 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f1e52bcb-7e63-432a-a939-2a9f1940f567 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:13.153034 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-f1e52bcb-7e63-432a-a939-2a9f1940f567 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1210 microversion: 2.1 time: 0.105601 Aug 24 17:51:13.153635 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 116/243] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:13 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1210 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:13.384477 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-2cc0848a-f991-4575-8158-127dfa55cd44 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:13.385657 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-2cc0848a-f991-4575-8158-127dfa55cd44 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:13.392915 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2cc0848a-f991-4575-8158-127dfa55cd44 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:13.393724 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2cc0848a-f991-4575-8158-127dfa55cd44 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:13.394187 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2cc0848a-f991-4575-8158-127dfa55cd44 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:13.394889 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2cc0848a-f991-4575-8158-127dfa55cd44 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:13.395338 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2cc0848a-f991-4575-8158-127dfa55cd44 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:13.395767 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2cc0848a-f991-4575-8158-127dfa55cd44 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:13.419037 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:13.545999 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-2cc0848a-f991-4575-8158-127dfa55cd44 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:13.554087 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-2cc0848a-f991-4575-8158-127dfa55cd44 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1321 microversion: 2.1 time: 0.173532 Aug 24 17:51:13.554663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 128/244] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:13 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:13.652507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-739000e9-7a1a-4d4c-a694-4e7949a49d6f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:13.653161 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-739000e9-7a1a-4d4c-a694-4e7949a49d6f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:13.659456 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-739000e9-7a1a-4d4c-a694-4e7949a49d6f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:13.659943 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-739000e9-7a1a-4d4c-a694-4e7949a49d6f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:13.660379 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-739000e9-7a1a-4d4c-a694-4e7949a49d6f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:13.661078 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-739000e9-7a1a-4d4c-a694-4e7949a49d6f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:13.661536 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-739000e9-7a1a-4d4c-a694-4e7949a49d6f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:13.662049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-739000e9-7a1a-4d4c-a694-4e7949a49d6f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:13.680785 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:13.823437 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-739000e9-7a1a-4d4c-a694-4e7949a49d6f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:13.834440 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-739000e9-7a1a-4d4c-a694-4e7949a49d6f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:13.836186 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-739000e9-7a1a-4d4c-a694-4e7949a49d6f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:13.839487 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-739000e9-7a1a-4d4c-a694-4e7949a49d6f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.189892 Aug 24 17:51:13.839487 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 117/245] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:13 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:14.183562 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a6d30b02-277a-4171-881e-e147cd3a54d7 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:14.184139 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a6d30b02-277a-4171-881e-e147cd3a54d7 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:14.190731 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a6d30b02-277a-4171-881e-e147cd3a54d7 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:14.193514 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a6d30b02-277a-4171-881e-e147cd3a54d7 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:14.193514 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a6d30b02-277a-4171-881e-e147cd3a54d7 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:14.193514 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a6d30b02-277a-4171-881e-e147cd3a54d7 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:14.193514 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a6d30b02-277a-4171-881e-e147cd3a54d7 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:14.194068 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a6d30b02-277a-4171-881e-e147cd3a54d7 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:14.273729 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a6d30b02-277a-4171-881e-e147cd3a54d7 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:14.284706 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a6d30b02-277a-4171-881e-e147cd3a54d7 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1274 microversion: 2.1 time: 0.105283 Aug 24 17:51:14.285609 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 129/246] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:14 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:14.578760 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-b3da30ec-d1de-4bea-b87d-0d1684418347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:14.584338 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-b3da30ec-d1de-4bea-b87d-0d1684418347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:14.593409 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b3da30ec-d1de-4bea-b87d-0d1684418347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:14.594057 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b3da30ec-d1de-4bea-b87d-0d1684418347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:14.594613 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b3da30ec-d1de-4bea-b87d-0d1684418347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:14.596463 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b3da30ec-d1de-4bea-b87d-0d1684418347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:14.596936 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b3da30ec-d1de-4bea-b87d-0d1684418347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:14.598012 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b3da30ec-d1de-4bea-b87d-0d1684418347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:14.800836 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-b3da30ec-d1de-4bea-b87d-0d1684418347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:14.808874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-b3da30ec-d1de-4bea-b87d-0d1684418347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1515 microversion: 2.1 time: 0.236499 Aug 24 17:51:14.809363 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 118/247] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:14 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:14.835756 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-143d9efe-8682-4da3-a79f-ae077511a605 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:14.838292 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-143d9efe-8682-4da3-a79f-ae077511a605 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:14.846869 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-143d9efe-8682-4da3-a79f-ae077511a605 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:14.847425 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-143d9efe-8682-4da3-a79f-ae077511a605 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:14.847931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-143d9efe-8682-4da3-a79f-ae077511a605 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:14.848690 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-143d9efe-8682-4da3-a79f-ae077511a605 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:14.849318 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-143d9efe-8682-4da3-a79f-ae077511a605 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:14.849733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-143d9efe-8682-4da3-a79f-ae077511a605 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:14.862499 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-7d497b96-e9be-4c7e-9de0-ca13cea1ba0a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:14.868553 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-7d497b96-e9be-4c7e-9de0-ca13cea1ba0a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:14.869724 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7d497b96-e9be-4c7e-9de0-ca13cea1ba0a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:14.870503 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7d497b96-e9be-4c7e-9de0-ca13cea1ba0a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:14.871011 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7d497b96-e9be-4c7e-9de0-ca13cea1ba0a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:14.871783 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7d497b96-e9be-4c7e-9de0-ca13cea1ba0a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:14.872438 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7d497b96-e9be-4c7e-9de0-ca13cea1ba0a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:14.874815 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7d497b96-e9be-4c7e-9de0-ca13cea1ba0a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:14.877622 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-143d9efe-8682-4da3-a79f-ae077511a605 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lazy-loading 'flavor' on Instance uuid e1deb7e5-c813-4c8b-829e-3c38e10fde3b {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:51:15.072683 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7d497b96-e9be-4c7e-9de0-ca13cea1ba0a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:15.084960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7d497b96-e9be-4c7e-9de0-ca13cea1ba0a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:15.086516 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7d497b96-e9be-4c7e-9de0-ca13cea1ba0a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:15.087733 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-7d497b96-e9be-4c7e-9de0-ca13cea1ba0a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.229824 Aug 24 17:51:15.088297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 119/248] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:14 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:15.271388 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-143d9efe-8682-4da3-a79f-ae077511a605 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "POST /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b/action" status: 200 len: 32 microversion: 2.1 time: 0.439646 Aug 24 17:51:15.271998 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 130/249] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 17:51:14 2022] POST /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b/action => generated 32 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:51:15.283974 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-554575a1-e15a-4a5e-90d6-28d353b1bb60 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:15.284885 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-554575a1-e15a-4a5e-90d6-28d353b1bb60 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:15.297948 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-554575a1-e15a-4a5e-90d6-28d353b1bb60 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:15.297948 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-554575a1-e15a-4a5e-90d6-28d353b1bb60 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:15.299849 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-554575a1-e15a-4a5e-90d6-28d353b1bb60 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:15.299849 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-554575a1-e15a-4a5e-90d6-28d353b1bb60 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:15.300693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-554575a1-e15a-4a5e-90d6-28d353b1bb60 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:15.301576 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-554575a1-e15a-4a5e-90d6-28d353b1bb60 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:15.308054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-4e8e499c-cf7d-472f-8f3f-d62e25481da6 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:15.309056 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4e8e499c-cf7d-472f-8f3f-d62e25481da6 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:15.316020 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e8e499c-cf7d-472f-8f3f-d62e25481da6 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:15.316605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e8e499c-cf7d-472f-8f3f-d62e25481da6 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:15.323436 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e8e499c-cf7d-472f-8f3f-d62e25481da6 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:15.323436 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e8e499c-cf7d-472f-8f3f-d62e25481da6 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:15.323436 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e8e499c-cf7d-472f-8f3f-d62e25481da6 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:15.323436 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e8e499c-cf7d-472f-8f3f-d62e25481da6 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:15.475633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-4e8e499c-cf7d-472f-8f3f-d62e25481da6 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:15.495949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-4e8e499c-cf7d-472f-8f3f-d62e25481da6 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1272 microversion: 2.1 time: 0.192385 Aug 24 17:51:15.506665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 131/250] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:15 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1272 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:15.876603 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-554575a1-e15a-4a5e-90d6-28d353b1bb60 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:15.884679 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-554575a1-e15a-4a5e-90d6-28d353b1bb60 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.606394 Aug 24 17:51:15.885339 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 120/251] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:15 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:16.113474 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-582142b6-aa87-4758-8472-041d64b5d82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:16.114388 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-582142b6-aa87-4758-8472-041d64b5d82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:16.125133 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-582142b6-aa87-4758-8472-041d64b5d82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.125625 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-582142b6-aa87-4758-8472-041d64b5d82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.133957 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-582142b6-aa87-4758-8472-041d64b5d82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:16.135806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-582142b6-aa87-4758-8472-041d64b5d82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.136304 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-582142b6-aa87-4758-8472-041d64b5d82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.136753 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-582142b6-aa87-4758-8472-041d64b5d82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:16.321798 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-582142b6-aa87-4758-8472-041d64b5d82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:16.334088 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-582142b6-aa87-4758-8472-041d64b5d82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:16.336103 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-582142b6-aa87-4758-8472-041d64b5d82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:16.337443 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-582142b6-aa87-4758-8472-041d64b5d82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.228376 Aug 24 17:51:16.338673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 132/252] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:16 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:16.539372 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c12ab4e1-29a4-4549-9498-40273a2c69c8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:16.540893 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c12ab4e1-29a4-4549-9498-40273a2c69c8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:16.553800 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c12ab4e1-29a4-4549-9498-40273a2c69c8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.555126 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c12ab4e1-29a4-4549-9498-40273a2c69c8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.555591 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c12ab4e1-29a4-4549-9498-40273a2c69c8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:16.556937 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c12ab4e1-29a4-4549-9498-40273a2c69c8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.557891 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c12ab4e1-29a4-4549-9498-40273a2c69c8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.558925 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c12ab4e1-29a4-4549-9498-40273a2c69c8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:16.765894 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c12ab4e1-29a4-4549-9498-40273a2c69c8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:16.778653 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c12ab4e1-29a4-4549-9498-40273a2c69c8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1314 microversion: 2.1 time: 0.247665 Aug 24 17:51:16.780860 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 121/253] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:16 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:16.914644 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0cdc5a6c-67f7-4911-8285-e800066b38d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:16.914644 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0cdc5a6c-67f7-4911-8285-e800066b38d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:16.914644 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:16.916077 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0cdc5a6c-67f7-4911-8285-e800066b38d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.916798 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0cdc5a6c-67f7-4911-8285-e800066b38d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.917234 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0cdc5a6c-67f7-4911-8285-e800066b38d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:16.918016 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0cdc5a6c-67f7-4911-8285-e800066b38d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.918686 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0cdc5a6c-67f7-4911-8285-e800066b38d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.919388 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0cdc5a6c-67f7-4911-8285-e800066b38d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:17.121256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0cdc5a6c-67f7-4911-8285-e800066b38d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:17.129844 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0cdc5a6c-67f7-4911-8285-e800066b38d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.225888 Aug 24 17:51:17.130447 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 133/254] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:16 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:17.267450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-88eea5fc-d8ee-4632-86ea-c608ca96b076 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Action: 'create', calling method: .version_select at 0x7fce7c069160>, body: {"keypair": {"name": "tempest-keypair-287417198", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjLOuWZAdZvSEQO3VUJH+0lXS1QJ8+LN5YJ7FJP8yPuw5Abr2rtc/Zt2h/yGL0NBgsuAEZfMUrPy2wZawGLu3uxjgxoFdF2tUedP9FYGmNujxGYAwByJ3oH7jZQG30V+Q=="}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:17.311178 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-88eea5fc-d8ee-4632-86ea-c608ca96b076 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Getting quotas for project 0a4d7fadea104c569ca29ff9be48089a. Resources: {'key_pairs'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:51:17.325039 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-88eea5fc-d8ee-4632-86ea-c608ca96b076 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Getting quotas for user 251bc85f89774142a97acd77895b14e9 and project 0a4d7fadea104c569ca29ff9be48089a. Resources: {'key_pairs'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:51:17.365047 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f0dbc163-c8d1-429e-a7fd-5085745e72f7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:17.366021 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f0dbc163-c8d1-429e-a7fd-5085745e72f7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:17.378075 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f0dbc163-c8d1-429e-a7fd-5085745e72f7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:17.378535 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f0dbc163-c8d1-429e-a7fd-5085745e72f7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:17.378963 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f0dbc163-c8d1-429e-a7fd-5085745e72f7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:17.379704 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f0dbc163-c8d1-429e-a7fd-5085745e72f7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:17.380246 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f0dbc163-c8d1-429e-a7fd-5085745e72f7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:17.380665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f0dbc163-c8d1-429e-a7fd-5085745e72f7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:17.474666 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-88eea5fc-d8ee-4632-86ea-c608ca96b076 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.215915 Aug 24 17:51:17.475978 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 122/255] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 17:51:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:51:17.578936 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f0dbc163-c8d1-429e-a7fd-5085745e72f7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:17.595828 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f0dbc163-c8d1-429e-a7fd-5085745e72f7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:17.597743 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f0dbc163-c8d1-429e-a7fd-5085745e72f7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:17.600116 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f0dbc163-c8d1-429e-a7fd-5085745e72f7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.239514 Aug 24 17:51:17.601288 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 134/256] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:17 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:51:17.666564 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-1ba05a5f-193d-488d-a74d-968b2da05907 req-93293b96-ec31-41a0-9ee7-2abb77d6ffe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df2b065-5db6-4170-8a4c-be333731546a", "tag": "fcb60ca7-9589-46e6-97f2-2b78be81320d"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:17.678677 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-1ba05a5f-193d-488d-a74d-968b2da05907 req-93293b96-ec31-41a0-9ee7-2abb77d6ffe6 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:17.679149 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-1ba05a5f-193d-488d-a74d-968b2da05907 req-93293b96-ec31-41a0-9ee7-2abb77d6ffe6 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:17.679578 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-1ba05a5f-193d-488d-a74d-968b2da05907 req-93293b96-ec31-41a0-9ee7-2abb77d6ffe6 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:17.691568 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-1ba05a5f-193d-488d-a74d-968b2da05907 req-93293b96-ec31-41a0-9ee7-2abb77d6ffe6 service nova] Creating event network-changed:fcb60ca7-9589-46e6-97f2-2b78be81320d for instance 1df2b065-5db6-4170-8a4c-be333731546a on hv-cinder-85442 Aug 24 17:51:17.696542 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-1ba05a5f-193d-488d-a74d-968b2da05907 req-93293b96-ec31-41a0-9ee7-2abb77d6ffe6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034484 Aug 24 17:51:17.697149 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 123/257] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:17.801553 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8ea5f39e-46a8-42a7-8707-46047fa46033 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:17.802229 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8ea5f39e-46a8-42a7-8707-46047fa46033 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:17.809218 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8ea5f39e-46a8-42a7-8707-46047fa46033 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:17.809800 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8ea5f39e-46a8-42a7-8707-46047fa46033 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:17.810346 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8ea5f39e-46a8-42a7-8707-46047fa46033 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:17.811096 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8ea5f39e-46a8-42a7-8707-46047fa46033 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:17.812081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8ea5f39e-46a8-42a7-8707-46047fa46033 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:17.812081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8ea5f39e-46a8-42a7-8707-46047fa46033 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:17.978004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8ea5f39e-46a8-42a7-8707-46047fa46033 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:17.990892 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-8ea5f39e-46a8-42a7-8707-46047fa46033 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1314 microversion: 2.1 time: 0.194191 Aug 24 17:51:17.991732 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 135/258] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:17 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:18.156604 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0b7c7a00-c091-44e5-93a4-011cf9dc50b5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:18.157966 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0b7c7a00-c091-44e5-93a4-011cf9dc50b5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:18.172829 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0b7c7a00-c091-44e5-93a4-011cf9dc50b5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:18.173739 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0b7c7a00-c091-44e5-93a4-011cf9dc50b5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:18.174590 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0b7c7a00-c091-44e5-93a4-011cf9dc50b5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:18.177882 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0b7c7a00-c091-44e5-93a4-011cf9dc50b5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:18.177882 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0b7c7a00-c091-44e5-93a4-011cf9dc50b5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:18.177882 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0b7c7a00-c091-44e5-93a4-011cf9dc50b5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:18.514436 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0b7c7a00-c091-44e5-93a4-011cf9dc50b5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:18.526725 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0b7c7a00-c091-44e5-93a4-011cf9dc50b5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.378104 Aug 24 17:51:18.548685 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 124/259] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:18 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:18.626725 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-c22e98ce-df88-4bec-a36c-bb901fc9dbf3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:18.627335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-c22e98ce-df88-4bec-a36c-bb901fc9dbf3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:18.634120 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c22e98ce-df88-4bec-a36c-bb901fc9dbf3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:18.634606 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c22e98ce-df88-4bec-a36c-bb901fc9dbf3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:18.635033 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c22e98ce-df88-4bec-a36c-bb901fc9dbf3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:18.635917 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c22e98ce-df88-4bec-a36c-bb901fc9dbf3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:18.636363 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c22e98ce-df88-4bec-a36c-bb901fc9dbf3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:18.636780 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c22e98ce-df88-4bec-a36c-bb901fc9dbf3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:18.788906 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c22e98ce-df88-4bec-a36c-bb901fc9dbf3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:18.799400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c22e98ce-df88-4bec-a36c-bb901fc9dbf3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:18.801127 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c22e98ce-df88-4bec-a36c-bb901fc9dbf3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:18.802322 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-c22e98ce-df88-4bec-a36c-bb901fc9dbf3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.180553 Aug 24 17:51:18.802880 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 136/260] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:18 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:19.019860 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c9a0451c-dd9b-476d-aa32-f685ddf5eb00 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:19.020490 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c9a0451c-dd9b-476d-aa32-f685ddf5eb00 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:19.028398 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9a0451c-dd9b-476d-aa32-f685ddf5eb00 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:19.028897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9a0451c-dd9b-476d-aa32-f685ddf5eb00 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:19.029332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9a0451c-dd9b-476d-aa32-f685ddf5eb00 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:19.030898 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9a0451c-dd9b-476d-aa32-f685ddf5eb00 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:19.031515 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9a0451c-dd9b-476d-aa32-f685ddf5eb00 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:19.031941 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9a0451c-dd9b-476d-aa32-f685ddf5eb00 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:19.258712 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c9a0451c-dd9b-476d-aa32-f685ddf5eb00 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:19.267595 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c9a0451c-dd9b-476d-aa32-f685ddf5eb00 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1314 microversion: 2.1 time: 0.251959 Aug 24 17:51:19.268184 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 125/261] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:19 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:19.558310 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0c2823ca-b88f-4347-9f56-72f9a64e9edf tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:19.559848 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0c2823ca-b88f-4347-9f56-72f9a64e9edf tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:19.576625 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c2823ca-b88f-4347-9f56-72f9a64e9edf tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:19.577609 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c2823ca-b88f-4347-9f56-72f9a64e9edf tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:19.578475 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c2823ca-b88f-4347-9f56-72f9a64e9edf tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:19.579809 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c2823ca-b88f-4347-9f56-72f9a64e9edf tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:19.580724 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c2823ca-b88f-4347-9f56-72f9a64e9edf tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:19.582580 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c2823ca-b88f-4347-9f56-72f9a64e9edf tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:19.788478 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0c2823ca-b88f-4347-9f56-72f9a64e9edf tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:19.797135 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0c2823ca-b88f-4347-9f56-72f9a64e9edf tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.246851 Aug 24 17:51:19.797723 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 137/262] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:19 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:19.826404 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a890f72f-2d30-43de-bcba-e6366e3568b5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:19.828098 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a890f72f-2d30-43de-bcba-e6366e3568b5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:19.835674 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a890f72f-2d30-43de-bcba-e6366e3568b5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:19.836420 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a890f72f-2d30-43de-bcba-e6366e3568b5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:19.836929 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a890f72f-2d30-43de-bcba-e6366e3568b5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:19.838090 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a890f72f-2d30-43de-bcba-e6366e3568b5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:19.838936 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a890f72f-2d30-43de-bcba-e6366e3568b5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:19.839900 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a890f72f-2d30-43de-bcba-e6366e3568b5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:20.065248 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a890f72f-2d30-43de-bcba-e6366e3568b5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:20.086323 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a890f72f-2d30-43de-bcba-e6366e3568b5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:20.088813 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a890f72f-2d30-43de-bcba-e6366e3568b5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:20.090888 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a890f72f-2d30-43de-bcba-e6366e3568b5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.268432 Aug 24 17:51:20.101982 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 126/263] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:19 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:20.290715 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-daa63ddf-f5bd-4137-b866-4733d8600104 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:20.292978 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-daa63ddf-f5bd-4137-b866-4733d8600104 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:20.300370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-daa63ddf-f5bd-4137-b866-4733d8600104 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:20.300856 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-daa63ddf-f5bd-4137-b866-4733d8600104 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:20.301308 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-daa63ddf-f5bd-4137-b866-4733d8600104 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:20.302144 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-daa63ddf-f5bd-4137-b866-4733d8600104 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:20.302653 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-daa63ddf-f5bd-4137-b866-4733d8600104 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:20.303075 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-daa63ddf-f5bd-4137-b866-4733d8600104 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:20.577633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=2 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:20.592854 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-daa63ddf-f5bd-4137-b866-4733d8600104 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:20.603192 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-daa63ddf-f5bd-4137-b866-4733d8600104 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1314 microversion: 2.1 time: 0.317158 Aug 24 17:51:20.617872 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 138/264] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:20 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:20.819315 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f45c6244-b122-48de-baef-c358890fc37f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:20.819949 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-f45c6244-b122-48de-baef-c358890fc37f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:20.827097 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f45c6244-b122-48de-baef-c358890fc37f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:20.827785 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f45c6244-b122-48de-baef-c358890fc37f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:20.828198 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f45c6244-b122-48de-baef-c358890fc37f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:20.828924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f45c6244-b122-48de-baef-c358890fc37f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:20.829405 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f45c6244-b122-48de-baef-c358890fc37f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:20.829835 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f45c6244-b122-48de-baef-c358890fc37f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:21.029723 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f45c6244-b122-48de-baef-c358890fc37f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:21.038607 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-f45c6244-b122-48de-baef-c358890fc37f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.223142 Aug 24 17:51:21.039269 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 127/265] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:20 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:21.059781 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-025e0964-7ef7-4e5c-bea1-7a3d4408a3d8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1562226779", "imageRef": "2d76d745-abc6-4a7b-b8d7-46566b66934b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60b1f9c5-31f3-434f-b4cc-45bc1ad7c5b8"}], "security_groups": [{"name": "tempest-securitygroup--252343653"}], "key_name": "tempest-keypair-287417198", "user_data": "}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:21.126336 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-63f0f8f2-0cd2-4c46-bf51-4341073125c8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:21.127022 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-63f0f8f2-0cd2-4c46-bf51-4341073125c8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:21.133952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-63f0f8f2-0cd2-4c46-bf51-4341073125c8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:21.134448 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-63f0f8f2-0cd2-4c46-bf51-4341073125c8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:21.134895 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-63f0f8f2-0cd2-4c46-bf51-4341073125c8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:21.135663 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-63f0f8f2-0cd2-4c46-bf51-4341073125c8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:21.143829 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-63f0f8f2-0cd2-4c46-bf51-4341073125c8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:21.144999 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-63f0f8f2-0cd2-4c46-bf51-4341073125c8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:21.193618 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.network.neutron [None req-025e0964-7ef7-4e5c-bea1-7a3d4408a3d8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] validate_networks() for [('60b1f9c5-31f3-434f-b4cc-45bc1ad7c5b8', None, None, None, None, None)] {{(pid=127676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:51:21.517728 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-63f0f8f2-0cd2-4c46-bf51-4341073125c8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:21.534038 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-63f0f8f2-0cd2-4c46-bf51-4341073125c8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:21.539191 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-63f0f8f2-0cd2-4c46-bf51-4341073125c8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:21.542054 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-63f0f8f2-0cd2-4c46-bf51-4341073125c8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.420547 Aug 24 17:51:21.543647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 128/266] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:21 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:51:21.626601 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-5418db73-6cba-4bdb-be18-95ff2a0f4bb8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:21.627541 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-5418db73-6cba-4bdb-be18-95ff2a0f4bb8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:21.633961 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5418db73-6cba-4bdb-be18-95ff2a0f4bb8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:21.634561 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5418db73-6cba-4bdb-be18-95ff2a0f4bb8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:21.635231 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5418db73-6cba-4bdb-be18-95ff2a0f4bb8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:21.635956 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5418db73-6cba-4bdb-be18-95ff2a0f4bb8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:21.636549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5418db73-6cba-4bdb-be18-95ff2a0f4bb8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:21.637251 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5418db73-6cba-4bdb-be18-95ff2a0f4bb8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:21.920121 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5418db73-6cba-4bdb-be18-95ff2a0f4bb8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:21.926930 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-025e0964-7ef7-4e5c-bea1-7a3d4408a3d8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Flavor limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:51:21.927357 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-025e0964-7ef7-4e5c-bea1-7a3d4408a3d8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Image limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:51:21.927838 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-025e0964-7ef7-4e5c-bea1-7a3d4408a3d8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Flavor pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:51:21.928248 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-025e0964-7ef7-4e5c-bea1-7a3d4408a3d8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Image pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:51:21.928660 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-025e0964-7ef7-4e5c-bea1-7a3d4408a3d8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:51:21.943917 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-025e0964-7ef7-4e5c-bea1-7a3d4408a3d8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:21.943917 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-025e0964-7ef7-4e5c-bea1-7a3d4408a3d8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:21.943917 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-025e0964-7ef7-4e5c-bea1-7a3d4408a3d8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:21.943917 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-025e0964-7ef7-4e5c-bea1-7a3d4408a3d8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:21.944202 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-025e0964-7ef7-4e5c-bea1-7a3d4408a3d8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:21.944202 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-025e0964-7ef7-4e5c-bea1-7a3d4408a3d8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:21.944908 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-5418db73-6cba-4bdb-be18-95ff2a0f4bb8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1314 microversion: 2.1 time: 0.322666 Aug 24 17:51:21.955314 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 129/267] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:21 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:21.967434 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-025e0964-7ef7-4e5c-bea1-7a3d4408a3d8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Getting quotas for project 0a4d7fadea104c569ca29ff9be48089a. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:51:21.973180 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-025e0964-7ef7-4e5c-bea1-7a3d4408a3d8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Getting quotas for user 251bc85f89774142a97acd77895b14e9 and project 0a4d7fadea104c569ca29ff9be48089a. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:51:21.986694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-025e0964-7ef7-4e5c-bea1-7a3d4408a3d8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Going to run 1 instances... {{(pid=127676) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:51:21.989176 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-025e0964-7ef7-4e5c-bea1-7a3d4408a3d8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d76d745-abc6-4a7b-b8d7-46566b66934b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:51:22.065314 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c2eb81f9-6a8b-47f0-91e3-f7d76bf99a0c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:22.066486 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c2eb81f9-6a8b-47f0-91e3-f7d76bf99a0c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:22.080829 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c2eb81f9-6a8b-47f0-91e3-f7d76bf99a0c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:22.081715 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c2eb81f9-6a8b-47f0-91e3-f7d76bf99a0c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:22.082585 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c2eb81f9-6a8b-47f0-91e3-f7d76bf99a0c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:22.084190 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c2eb81f9-6a8b-47f0-91e3-f7d76bf99a0c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:22.085621 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c2eb81f9-6a8b-47f0-91e3-f7d76bf99a0c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:22.086767 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c2eb81f9-6a8b-47f0-91e3-f7d76bf99a0c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:22.140934 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-025e0964-7ef7-4e5c-bea1-7a3d4408a3d8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.084064 Aug 24 17:51:22.147455 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 139/268] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 17:51:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:51:22.154513 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-9a1caec6-6400-43fe-99e3-2e35295ccd4a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:22.156017 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-9a1caec6-6400-43fe-99e3-2e35295ccd4a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:22.285201 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-9a1caec6-6400-43fe-99e3-2e35295ccd4a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:22.301843 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-9a1caec6-6400-43fe-99e3-2e35295ccd4a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1241 microversion: 2.1 time: 0.151193 Aug 24 17:51:22.303712 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 140/269] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:22 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1241 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:22.444659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c2eb81f9-6a8b-47f0-91e3-f7d76bf99a0c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:22.461081 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c2eb81f9-6a8b-47f0-91e3-f7d76bf99a0c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.403412 Aug 24 17:51:22.462526 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 130/270] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:22 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:22.568213 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-43c04e29-ec42-4a73-a1d2-2692e54f4b9c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:22.568811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-43c04e29-ec42-4a73-a1d2-2692e54f4b9c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:22.575338 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-43c04e29-ec42-4a73-a1d2-2692e54f4b9c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:22.576042 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-43c04e29-ec42-4a73-a1d2-2692e54f4b9c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:22.576547 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-43c04e29-ec42-4a73-a1d2-2692e54f4b9c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:22.577319 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-43c04e29-ec42-4a73-a1d2-2692e54f4b9c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:22.577747 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-43c04e29-ec42-4a73-a1d2-2692e54f4b9c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:22.578207 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-43c04e29-ec42-4a73-a1d2-2692e54f4b9c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:22.745709 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-43c04e29-ec42-4a73-a1d2-2692e54f4b9c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:22.757237 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-43c04e29-ec42-4a73-a1d2-2692e54f4b9c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:22.759341 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-43c04e29-ec42-4a73-a1d2-2692e54f4b9c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:22.764815 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-43c04e29-ec42-4a73-a1d2-2692e54f4b9c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.196772 Aug 24 17:51:22.764815 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 141/271] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:22 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:22.983386 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9d329644-08f1-4f88-8f3d-6d157e930ca8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:22.984136 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9d329644-08f1-4f88-8f3d-6d157e930ca8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:22.990758 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9d329644-08f1-4f88-8f3d-6d157e930ca8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:22.991282 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9d329644-08f1-4f88-8f3d-6d157e930ca8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:22.991859 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9d329644-08f1-4f88-8f3d-6d157e930ca8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:22.992454 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9d329644-08f1-4f88-8f3d-6d157e930ca8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:22.992912 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9d329644-08f1-4f88-8f3d-6d157e930ca8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:22.993340 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9d329644-08f1-4f88-8f3d-6d157e930ca8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:23.200679 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9d329644-08f1-4f88-8f3d-6d157e930ca8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:23.211257 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9d329644-08f1-4f88-8f3d-6d157e930ca8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1314 microversion: 2.1 time: 0.232414 Aug 24 17:51:23.212107 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 131/272] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:22 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:23.331360 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7d6c0307-0bcc-421c-805d-be4a3f8dd966 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:23.332493 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7d6c0307-0bcc-421c-805d-be4a3f8dd966 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:23.446667 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7d6c0307-0bcc-421c-805d-be4a3f8dd966 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:23.461721 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7d6c0307-0bcc-421c-805d-be4a3f8dd966 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1241 microversion: 2.1 time: 0.135313 Aug 24 17:51:23.463275 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 142/273] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:23 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1241 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:23.517117 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-7903210d-7781-46ac-91cd-ebcb0e853374 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:23.517117 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-7903210d-7781-46ac-91cd-ebcb0e853374 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:23.525255 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7903210d-7781-46ac-91cd-ebcb0e853374 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:23.525826 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7903210d-7781-46ac-91cd-ebcb0e853374 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:23.526226 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7903210d-7781-46ac-91cd-ebcb0e853374 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:23.528506 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7903210d-7781-46ac-91cd-ebcb0e853374 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:23.528959 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7903210d-7781-46ac-91cd-ebcb0e853374 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:23.529510 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7903210d-7781-46ac-91cd-ebcb0e853374 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:23.652882 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-89a78b53-bfa5-4930-8135-2064a0e50030 req-5138635c-22a8-4a7f-ad1c-b377e7008d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df2b065-5db6-4170-8a4c-be333731546a", "name": "network-vif-plugged", "status": "completed", "tag": "fcb60ca7-9589-46e6-97f2-2b78be81320d"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:23.674872 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-89a78b53-bfa5-4930-8135-2064a0e50030 req-5138635c-22a8-4a7f-ad1c-b377e7008d5b service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:23.675709 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-89a78b53-bfa5-4930-8135-2064a0e50030 req-5138635c-22a8-4a7f-ad1c-b377e7008d5b service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:23.677216 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-89a78b53-bfa5-4930-8135-2064a0e50030 req-5138635c-22a8-4a7f-ad1c-b377e7008d5b service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:23.703185 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-89a78b53-bfa5-4930-8135-2064a0e50030 req-5138635c-22a8-4a7f-ad1c-b377e7008d5b service nova] Creating event network-vif-plugged:fcb60ca7-9589-46e6-97f2-2b78be81320d for instance 1df2b065-5db6-4170-8a4c-be333731546a on hv-cinder-85442 Aug 24 17:51:23.715670 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-89a78b53-bfa5-4930-8135-2064a0e50030 req-5138635c-22a8-4a7f-ad1c-b377e7008d5b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071404 Aug 24 17:51:23.717650 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 143/274] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:51:23.777496 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7903210d-7781-46ac-91cd-ebcb0e853374 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:23.806881 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-112c80ba-3cff-43fd-baa7-38711b9ff8d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:23.806881 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-112c80ba-3cff-43fd-baa7-38711b9ff8d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:23.815975 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-7903210d-7781-46ac-91cd-ebcb0e853374 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.317176 Aug 24 17:51:23.817273 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 132/275] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:23 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:23.846322 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-112c80ba-3cff-43fd-baa7-38711b9ff8d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:23.846322 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-112c80ba-3cff-43fd-baa7-38711b9ff8d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:23.846322 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-112c80ba-3cff-43fd-baa7-38711b9ff8d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:23.846322 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-112c80ba-3cff-43fd-baa7-38711b9ff8d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:23.847184 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-112c80ba-3cff-43fd-baa7-38711b9ff8d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:23.848357 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-112c80ba-3cff-43fd-baa7-38711b9ff8d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:24.164592 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-112c80ba-3cff-43fd-baa7-38711b9ff8d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:24.177645 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-112c80ba-3cff-43fd-baa7-38711b9ff8d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:24.179861 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-112c80ba-3cff-43fd-baa7-38711b9ff8d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:24.181351 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-112c80ba-3cff-43fd-baa7-38711b9ff8d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.388057 Aug 24 17:51:24.182502 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 144/276] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:23 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:24.243532 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-029d11f2-6c5d-406a-b111-abb5ac67ceb5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:24.244373 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-029d11f2-6c5d-406a-b111-abb5ac67ceb5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:24.258308 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-029d11f2-6c5d-406a-b111-abb5ac67ceb5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:24.258308 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-029d11f2-6c5d-406a-b111-abb5ac67ceb5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:24.258308 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-029d11f2-6c5d-406a-b111-abb5ac67ceb5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:24.258308 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-029d11f2-6c5d-406a-b111-abb5ac67ceb5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:24.258781 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-029d11f2-6c5d-406a-b111-abb5ac67ceb5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:24.259455 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-029d11f2-6c5d-406a-b111-abb5ac67ceb5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:24.492183 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-029d11f2-6c5d-406a-b111-abb5ac67ceb5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:24.496520 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-77f20d48-f82b-4937-80bb-9f4d64fbe8db tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:24.498080 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-77f20d48-f82b-4937-80bb-9f4d64fbe8db tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:24.503332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-029d11f2-6c5d-406a-b111-abb5ac67ceb5 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1314 microversion: 2.1 time: 0.263779 Aug 24 17:51:24.505736 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-77f20d48-f82b-4937-80bb-9f4d64fbe8db tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:24.506306 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-77f20d48-f82b-4937-80bb-9f4d64fbe8db tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:24.506747 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-77f20d48-f82b-4937-80bb-9f4d64fbe8db tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:24.507471 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-77f20d48-f82b-4937-80bb-9f4d64fbe8db tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:24.508016 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-77f20d48-f82b-4937-80bb-9f4d64fbe8db tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:24.508441 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-77f20d48-f82b-4937-80bb-9f4d64fbe8db tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:24.517716 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 133/277] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:24 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:24.622737 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-77f20d48-f82b-4937-80bb-9f4d64fbe8db tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:24.632898 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-77f20d48-f82b-4937-80bb-9f4d64fbe8db tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1237 microversion: 2.1 time: 0.140454 Aug 24 17:51:24.633553 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 145/278] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:24 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1237 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:24.665874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-36e91470-48b7-4241-a6f1-02cbefd2bf30 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:24.673188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-36e91470-48b7-4241-a6f1-02cbefd2bf30 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:24.673675 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-36e91470-48b7-4241-a6f1-02cbefd2bf30 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:24.674150 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-36e91470-48b7-4241-a6f1-02cbefd2bf30 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:24.739152 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-36e91470-48b7-4241-a6f1-02cbefd2bf30 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Going to try to stop instance {{(pid=127677) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 17:51:24.843255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-078bf670-4c0a-435c-ac03-61294939956f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:24.847166 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-078bf670-4c0a-435c-ac03-61294939956f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:24.851557 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-078bf670-4c0a-435c-ac03-61294939956f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:24.852041 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-078bf670-4c0a-435c-ac03-61294939956f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:24.852651 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-078bf670-4c0a-435c-ac03-61294939956f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:24.853200 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-078bf670-4c0a-435c-ac03-61294939956f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:24.853657 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-078bf670-4c0a-435c-ac03-61294939956f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:24.854111 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-078bf670-4c0a-435c-ac03-61294939956f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:24.880262 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:24.953340 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:25.033136 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-078bf670-4c0a-435c-ac03-61294939956f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:25.043865 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-078bf670-4c0a-435c-ac03-61294939956f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.208464 Aug 24 17:51:25.045885 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 146/279] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:24 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:25.071927 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-36e91470-48b7-4241-a6f1-02cbefd2bf30 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "POST /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f/action" status: 202 len: 0 microversion: 2.1 time: 0.409609 Aug 24 17:51:25.077168 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 134/280] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 17:51:24 2022] POST /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:51:25.084580 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-67caeb4b-bca8-4ade-9d83-0622fa31b6ce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:25.085553 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-67caeb4b-bca8-4ade-9d83-0622fa31b6ce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:25.095605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-67caeb4b-bca8-4ade-9d83-0622fa31b6ce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:25.096408 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-67caeb4b-bca8-4ade-9d83-0622fa31b6ce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:25.097119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-67caeb4b-bca8-4ade-9d83-0622fa31b6ce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:25.098353 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-67caeb4b-bca8-4ade-9d83-0622fa31b6ce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:25.099132 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-67caeb4b-bca8-4ade-9d83-0622fa31b6ce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:25.103466 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-67caeb4b-bca8-4ade-9d83-0622fa31b6ce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:25.217700 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e3612228-cf9f-49ae-ab56-bd05427b09bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:25.224047 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-e3612228-cf9f-49ae-ab56-bd05427b09bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:25.229983 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e3612228-cf9f-49ae-ab56-bd05427b09bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:25.230750 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e3612228-cf9f-49ae-ab56-bd05427b09bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:25.231462 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e3612228-cf9f-49ae-ab56-bd05427b09bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:25.233141 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e3612228-cf9f-49ae-ab56-bd05427b09bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:25.233949 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e3612228-cf9f-49ae-ab56-bd05427b09bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:25.234430 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e3612228-cf9f-49ae-ab56-bd05427b09bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:25.249832 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-67caeb4b-bca8-4ade-9d83-0622fa31b6ce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:25.265845 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-67caeb4b-bca8-4ade-9d83-0622fa31b6ce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1722 microversion: 2.1 time: 0.186425 Aug 24 17:51:25.266522 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 147/281] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:25 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:25.430779 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e3612228-cf9f-49ae-ab56-bd05427b09bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:25.442295 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e3612228-cf9f-49ae-ab56-bd05427b09bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:25.443207 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e3612228-cf9f-49ae-ab56-bd05427b09bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:25.444837 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-e3612228-cf9f-49ae-ab56-bd05427b09bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.235352 Aug 24 17:51:25.447208 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 135/282] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:25 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:51:25.525289 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-6f684705-34a0-4c82-a1be-87e02c2d28b8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:25.526286 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-6f684705-34a0-4c82-a1be-87e02c2d28b8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:25.533132 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6f684705-34a0-4c82-a1be-87e02c2d28b8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:25.536829 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6f684705-34a0-4c82-a1be-87e02c2d28b8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:25.536829 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6f684705-34a0-4c82-a1be-87e02c2d28b8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:25.536829 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6f684705-34a0-4c82-a1be-87e02c2d28b8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:25.536829 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6f684705-34a0-4c82-a1be-87e02c2d28b8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:25.537214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6f684705-34a0-4c82-a1be-87e02c2d28b8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:25.672018 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-db5eeaa4-7df1-42c4-a934-df67e0fde37b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:25.672949 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-db5eeaa4-7df1-42c4-a934-df67e0fde37b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:25.681684 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-db5eeaa4-7df1-42c4-a934-df67e0fde37b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:25.682272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-db5eeaa4-7df1-42c4-a934-df67e0fde37b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:25.683588 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-db5eeaa4-7df1-42c4-a934-df67e0fde37b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:25.684440 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-db5eeaa4-7df1-42c4-a934-df67e0fde37b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:25.684972 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-db5eeaa4-7df1-42c4-a934-df67e0fde37b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:25.685439 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-db5eeaa4-7df1-42c4-a934-df67e0fde37b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:25.699446 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-6f684705-34a0-4c82-a1be-87e02c2d28b8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:25.712108 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-6f684705-34a0-4c82-a1be-87e02c2d28b8 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1314 microversion: 2.1 time: 0.190531 Aug 24 17:51:25.729924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 148/283] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:25 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:25.760981 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-db5eeaa4-7df1-42c4-a934-df67e0fde37b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:25.769022 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-db5eeaa4-7df1-42c4-a934-df67e0fde37b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1293 microversion: 2.1 time: 0.104926 Aug 24 17:51:25.769717 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 136/284] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:25 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1293 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:26.079353 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-16165635-e47a-49af-a655-3e5f81991025 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:26.079962 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-16165635-e47a-49af-a655-3e5f81991025 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:26.086720 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-16165635-e47a-49af-a655-3e5f81991025 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:26.087232 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-16165635-e47a-49af-a655-3e5f81991025 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:26.087669 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-16165635-e47a-49af-a655-3e5f81991025 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:26.088361 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-16165635-e47a-49af-a655-3e5f81991025 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:26.088852 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-16165635-e47a-49af-a655-3e5f81991025 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:26.089284 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-16165635-e47a-49af-a655-3e5f81991025 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:26.236727 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-16165635-e47a-49af-a655-3e5f81991025 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:26.245049 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-16165635-e47a-49af-a655-3e5f81991025 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.169932 Aug 24 17:51:26.245750 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 149/285] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:26 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:26.288004 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-99106bb1-88a9-4ade-b824-fbf6682783e2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:26.288839 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-99106bb1-88a9-4ade-b824-fbf6682783e2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:26.299395 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-99106bb1-88a9-4ade-b824-fbf6682783e2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:26.303616 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-99106bb1-88a9-4ade-b824-fbf6682783e2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:26.303616 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-99106bb1-88a9-4ade-b824-fbf6682783e2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:26.303616 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-99106bb1-88a9-4ade-b824-fbf6682783e2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:26.303616 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-99106bb1-88a9-4ade-b824-fbf6682783e2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:26.303994 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-99106bb1-88a9-4ade-b824-fbf6682783e2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:26.457101 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-99106bb1-88a9-4ade-b824-fbf6682783e2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:26.467099 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-99106bb1-88a9-4ade-b824-fbf6682783e2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1722 microversion: 2.1 time: 0.183523 Aug 24 17:51:26.468010 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 137/286] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:26 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:26.471356 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-1d2cdb0e-302d-4bbd-a300-e637814365a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:26.471922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-1d2cdb0e-302d-4bbd-a300-e637814365a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:26.479343 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1d2cdb0e-302d-4bbd-a300-e637814365a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:26.479922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1d2cdb0e-302d-4bbd-a300-e637814365a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:26.480366 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1d2cdb0e-302d-4bbd-a300-e637814365a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:26.481120 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1d2cdb0e-302d-4bbd-a300-e637814365a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:26.481578 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1d2cdb0e-302d-4bbd-a300-e637814365a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:26.482096 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1d2cdb0e-302d-4bbd-a300-e637814365a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:26.633542 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-1d2cdb0e-302d-4bbd-a300-e637814365a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:26.647223 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-1d2cdb0e-302d-4bbd-a300-e637814365a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:26.648815 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-1d2cdb0e-302d-4bbd-a300-e637814365a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:26.650254 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-1d2cdb0e-302d-4bbd-a300-e637814365a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.183150 Aug 24 17:51:26.660841 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 150/287] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:26 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:51:26.737420 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-90b602a8-761c-4b0a-a3aa-e64f066ef7bc tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:26.738158 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-90b602a8-761c-4b0a-a3aa-e64f066ef7bc tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:26.745095 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90b602a8-761c-4b0a-a3aa-e64f066ef7bc tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:26.745589 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90b602a8-761c-4b0a-a3aa-e64f066ef7bc tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:26.746071 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90b602a8-761c-4b0a-a3aa-e64f066ef7bc tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:26.746779 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90b602a8-761c-4b0a-a3aa-e64f066ef7bc tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:26.747630 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90b602a8-761c-4b0a-a3aa-e64f066ef7bc tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:26.748811 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90b602a8-761c-4b0a-a3aa-e64f066ef7bc tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:26.792538 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5ffb41aa-a104-4617-99bd-4bf7ac55ea94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:26.793816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5ffb41aa-a104-4617-99bd-4bf7ac55ea94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:26.802500 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5ffb41aa-a104-4617-99bd-4bf7ac55ea94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:26.806878 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5ffb41aa-a104-4617-99bd-4bf7ac55ea94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:26.806878 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5ffb41aa-a104-4617-99bd-4bf7ac55ea94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:26.806878 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5ffb41aa-a104-4617-99bd-4bf7ac55ea94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:26.806878 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5ffb41aa-a104-4617-99bd-4bf7ac55ea94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:26.807457 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5ffb41aa-a104-4617-99bd-4bf7ac55ea94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:26.898992 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5ffb41aa-a104-4617-99bd-4bf7ac55ea94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:26.930803 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5ffb41aa-a104-4617-99bd-4bf7ac55ea94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1301 microversion: 2.1 time: 0.142945 Aug 24 17:51:26.931999 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 151/288] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:26 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1301 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:27.079305 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-90b602a8-761c-4b0a-a3aa-e64f066ef7bc tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:27.087940 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-90b602a8-761c-4b0a-a3aa-e64f066ef7bc tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1463 microversion: 2.1 time: 0.354294 Aug 24 17:51:27.088809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 138/289] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:26 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1463 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:27.137700 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0a3f65a4-7983-47fd-b078-29640601f120 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:27.138224 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0a3f65a4-7983-47fd-b078-29640601f120 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:27.150802 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0a3f65a4-7983-47fd-b078-29640601f120 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.152346 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0a3f65a4-7983-47fd-b078-29640601f120 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.152894 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0a3f65a4-7983-47fd-b078-29640601f120 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.153976 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0a3f65a4-7983-47fd-b078-29640601f120 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.155358 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0a3f65a4-7983-47fd-b078-29640601f120 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.156115 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0a3f65a4-7983-47fd-b078-29640601f120 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.189714 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0a3f65a4-7983-47fd-b078-29640601f120 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Going to try to terminate instance {{(pid=127676) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:51:27.267951 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-7cdc0066-8d72-4bb5-bfaa-e82b2ab502cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:27.268623 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-7cdc0066-8d72-4bb5-bfaa-e82b2ab502cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:27.275039 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7cdc0066-8d72-4bb5-bfaa-e82b2ab502cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.283403 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7cdc0066-8d72-4bb5-bfaa-e82b2ab502cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.283403 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7cdc0066-8d72-4bb5-bfaa-e82b2ab502cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.283403 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7cdc0066-8d72-4bb5-bfaa-e82b2ab502cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.283403 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7cdc0066-8d72-4bb5-bfaa-e82b2ab502cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.283898 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7cdc0066-8d72-4bb5-bfaa-e82b2ab502cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.335756 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=4 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:27.458545 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7cdc0066-8d72-4bb5-bfaa-e82b2ab502cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:27.472944 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-7cdc0066-8d72-4bb5-bfaa-e82b2ab502cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.209008 Aug 24 17:51:27.474490 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 139/290] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:27 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:27.493033 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-da8cf4eb-5581-4b56-8daa-5a9cbe18df1a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:27.495335 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-da8cf4eb-5581-4b56-8daa-5a9cbe18df1a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:27.507238 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-da8cf4eb-5581-4b56-8daa-5a9cbe18df1a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.508050 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-da8cf4eb-5581-4b56-8daa-5a9cbe18df1a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.518967 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-da8cf4eb-5581-4b56-8daa-5a9cbe18df1a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.522769 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-da8cf4eb-5581-4b56-8daa-5a9cbe18df1a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.528274 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-da8cf4eb-5581-4b56-8daa-5a9cbe18df1a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.528274 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-da8cf4eb-5581-4b56-8daa-5a9cbe18df1a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.693952 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0a3f65a4-7983-47fd-b078-29640601f120 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 204 len: 0 microversion: 2.1 time: 0.559731 Aug 24 17:51:27.695350 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 152/291] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:51:27 2022] DELETE /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:51:27.705205 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5bd7abe0-505b-4efd-8275-63ac9e98e866 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:27.711634 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5bd7abe0-505b-4efd-8275-63ac9e98e866 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:27.711914 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-da8cf4eb-5581-4b56-8daa-5a9cbe18df1a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:27.713102 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5bd7abe0-505b-4efd-8275-63ac9e98e866 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.713723 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5bd7abe0-505b-4efd-8275-63ac9e98e866 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.714279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5bd7abe0-505b-4efd-8275-63ac9e98e866 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.715059 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5bd7abe0-505b-4efd-8275-63ac9e98e866 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.715792 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5bd7abe0-505b-4efd-8275-63ac9e98e866 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.716424 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5bd7abe0-505b-4efd-8275-63ac9e98e866 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.719514 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-da8cf4eb-5581-4b56-8daa-5a9cbe18df1a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1722 microversion: 2.1 time: 0.232661 Aug 24 17:51:27.720332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 140/292] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:27 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:27.748400 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-03eacbb5-8aa2-4470-bfd0-0a25f75b831e tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:27.749349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-03eacbb5-8aa2-4470-bfd0-0a25f75b831e tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:27.756088 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:27.758226 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-03eacbb5-8aa2-4470-bfd0-0a25f75b831e tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.758857 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-03eacbb5-8aa2-4470-bfd0-0a25f75b831e tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.759383 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-03eacbb5-8aa2-4470-bfd0-0a25f75b831e tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.760230 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-03eacbb5-8aa2-4470-bfd0-0a25f75b831e tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.760905 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-03eacbb5-8aa2-4470-bfd0-0a25f75b831e tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.761414 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-03eacbb5-8aa2-4470-bfd0-0a25f75b831e tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.944077 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5bd7abe0-505b-4efd-8275-63ac9e98e866 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:27.964410 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5bd7abe0-505b-4efd-8275-63ac9e98e866 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:27.966008 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5bd7abe0-505b-4efd-8275-63ac9e98e866 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:27.967720 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5bd7abe0-505b-4efd-8275-63ac9e98e866 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1742 microversion: 2.20 time: 0.267540 Aug 24 17:51:27.968292 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 153/293] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:27 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1742 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:27.973011 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8012c84f-aea7-45c9-8e3f-cf9b749d56a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:27.973623 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8012c84f-aea7-45c9-8e3f-cf9b749d56a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:27.979980 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8012c84f-aea7-45c9-8e3f-cf9b749d56a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.980480 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8012c84f-aea7-45c9-8e3f-cf9b749d56a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.980906 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8012c84f-aea7-45c9-8e3f-cf9b749d56a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.981607 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8012c84f-aea7-45c9-8e3f-cf9b749d56a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.982103 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8012c84f-aea7-45c9-8e3f-cf9b749d56a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.983403 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8012c84f-aea7-45c9-8e3f-cf9b749d56a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.992769 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-03eacbb5-8aa2-4470-bfd0-0a25f75b831e tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:28.003863 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-03eacbb5-8aa2-4470-bfd0-0a25f75b831e tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1469 microversion: 2.1 time: 0.271210 Aug 24 17:51:28.004460 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 141/294] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:27 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1469 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:28.318147 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8012c84f-aea7-45c9-8e3f-cf9b749d56a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:28.328120 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-8012c84f-aea7-45c9-8e3f-cf9b749d56a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1366 microversion: 2.1 time: 0.358731 Aug 24 17:51:28.328723 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 154/295] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:27 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:28.502788 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d0263214-8ff0-4b67-8ec5-cb88682588a8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:28.502788 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d0263214-8ff0-4b67-8ec5-cb88682588a8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:28.519232 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d0263214-8ff0-4b67-8ec5-cb88682588a8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:28.520557 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d0263214-8ff0-4b67-8ec5-cb88682588a8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:28.521345 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d0263214-8ff0-4b67-8ec5-cb88682588a8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:28.522647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d0263214-8ff0-4b67-8ec5-cb88682588a8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:28.523493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d0263214-8ff0-4b67-8ec5-cb88682588a8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:28.524347 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d0263214-8ff0-4b67-8ec5-cb88682588a8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:28.751333 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d0263214-8ff0-4b67-8ec5-cb88682588a8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:28.759386 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-58fc8ca0-381a-45bd-92f3-93a9cb4b469f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:28.761203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-58fc8ca0-381a-45bd-92f3-93a9cb4b469f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:28.761888 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d0263214-8ff0-4b67-8ec5-cb88682588a8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.269693 Aug 24 17:51:28.762944 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 142/296] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:28 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:28.775775 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58fc8ca0-381a-45bd-92f3-93a9cb4b469f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:28.778467 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58fc8ca0-381a-45bd-92f3-93a9cb4b469f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:28.779070 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58fc8ca0-381a-45bd-92f3-93a9cb4b469f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:28.779954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58fc8ca0-381a-45bd-92f3-93a9cb4b469f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:28.782515 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58fc8ca0-381a-45bd-92f3-93a9cb4b469f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:28.783097 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58fc8ca0-381a-45bd-92f3-93a9cb4b469f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:28.978262 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-58fc8ca0-381a-45bd-92f3-93a9cb4b469f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:28.988244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-58fc8ca0-381a-45bd-92f3-93a9cb4b469f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1722 microversion: 2.1 time: 0.243004 Aug 24 17:51:28.988862 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 155/297] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:28 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:29.000513 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-5d72a207-6f0a-4960-971f-809995290698 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:29.001643 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-5d72a207-6f0a-4960-971f-809995290698 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:29.007690 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5d72a207-6f0a-4960-971f-809995290698 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:29.008176 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5d72a207-6f0a-4960-971f-809995290698 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:29.008616 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5d72a207-6f0a-4960-971f-809995290698 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:29.009328 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5d72a207-6f0a-4960-971f-809995290698 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:29.009787 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5d72a207-6f0a-4960-971f-809995290698 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:29.010248 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5d72a207-6f0a-4960-971f-809995290698 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:29.027548 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d4fdeeed-3d77-4488-8483-afdd7652848f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:29.030377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d4fdeeed-3d77-4488-8483-afdd7652848f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:29.041935 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d4fdeeed-3d77-4488-8483-afdd7652848f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:29.042447 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d4fdeeed-3d77-4488-8483-afdd7652848f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:29.042887 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d4fdeeed-3d77-4488-8483-afdd7652848f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:29.043647 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d4fdeeed-3d77-4488-8483-afdd7652848f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:29.044091 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d4fdeeed-3d77-4488-8483-afdd7652848f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:29.045071 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d4fdeeed-3d77-4488-8483-afdd7652848f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:29.310046 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5d72a207-6f0a-4960-971f-809995290698 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:29.331685 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5d72a207-6f0a-4960-971f-809995290698 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:29.335699 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5d72a207-6f0a-4960-971f-809995290698 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:29.338978 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-5d72a207-6f0a-4960-971f-809995290698 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1742 microversion: 2.20 time: 0.341907 Aug 24 17:51:29.340308 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 143/298] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:28 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1742 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:29.353408 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d4fdeeed-3d77-4488-8483-afdd7652848f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:29.368508 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9db38d39-c628-464f-9efd-46251130d7f0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:29.373944 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9db38d39-c628-464f-9efd-46251130d7f0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:29.383660 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9db38d39-c628-464f-9efd-46251130d7f0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:29.384603 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9db38d39-c628-464f-9efd-46251130d7f0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:29.385321 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9db38d39-c628-464f-9efd-46251130d7f0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:29.386415 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9db38d39-c628-464f-9efd-46251130d7f0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:29.387123 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9db38d39-c628-464f-9efd-46251130d7f0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:29.387835 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9db38d39-c628-464f-9efd-46251130d7f0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:29.399755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d4fdeeed-3d77-4488-8483-afdd7652848f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1469 microversion: 2.1 time: 0.375887 Aug 24 17:51:29.406793 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 156/299] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:29 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1469 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:29.621508 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9db38d39-c628-464f-9efd-46251130d7f0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:29.638153 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9db38d39-c628-464f-9efd-46251130d7f0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1366 microversion: 2.1 time: 0.286069 Aug 24 17:51:29.645959 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 144/300] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:29 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:29.805226 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e92f1768-f418-4b94-9b9d-5ef7e5caca5c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:29.810035 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e92f1768-f418-4b94-9b9d-5ef7e5caca5c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:29.816757 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e92f1768-f418-4b94-9b9d-5ef7e5caca5c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:29.817685 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e92f1768-f418-4b94-9b9d-5ef7e5caca5c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:29.818316 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e92f1768-f418-4b94-9b9d-5ef7e5caca5c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:29.819109 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e92f1768-f418-4b94-9b9d-5ef7e5caca5c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:29.819883 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e92f1768-f418-4b94-9b9d-5ef7e5caca5c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:29.820400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e92f1768-f418-4b94-9b9d-5ef7e5caca5c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.016649 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-45c1d3d1-bcff-4882-aede-7115549b6b32 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:30.016649 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-45c1d3d1-bcff-4882-aede-7115549b6b32 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:30.033906 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45c1d3d1-bcff-4882-aede-7115549b6b32 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.041831 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45c1d3d1-bcff-4882-aede-7115549b6b32 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.041831 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45c1d3d1-bcff-4882-aede-7115549b6b32 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.042931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45c1d3d1-bcff-4882-aede-7115549b6b32 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.043575 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45c1d3d1-bcff-4882-aede-7115549b6b32 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.044293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45c1d3d1-bcff-4882-aede-7115549b6b32 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.114837 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e92f1768-f418-4b94-9b9d-5ef7e5caca5c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:30.129741 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e92f1768-f418-4b94-9b9d-5ef7e5caca5c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.330133 Aug 24 17:51:30.131035 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 157/301] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:29 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:30.323835 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-45c1d3d1-bcff-4882-aede-7115549b6b32 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:30.334003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-45c1d3d1-bcff-4882-aede-7115549b6b32 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1722 microversion: 2.1 time: 0.324177 Aug 24 17:51:30.348748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 145/302] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:30 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1722 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:30.366680 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5fadd3e3-61d5-4ca4-bbf4-f380f9fcd678 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:30.367315 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5fadd3e3-61d5-4ca4-bbf4-f380f9fcd678 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:30.375245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5fadd3e3-61d5-4ca4-bbf4-f380f9fcd678 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.375973 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5fadd3e3-61d5-4ca4-bbf4-f380f9fcd678 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.376648 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5fadd3e3-61d5-4ca4-bbf4-f380f9fcd678 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.377377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5fadd3e3-61d5-4ca4-bbf4-f380f9fcd678 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.377836 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5fadd3e3-61d5-4ca4-bbf4-f380f9fcd678 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.378646 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5fadd3e3-61d5-4ca4-bbf4-f380f9fcd678 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.427570 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9126d4ee-4700-4a6c-8ef3-f707f5f5d723 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:30.428382 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9126d4ee-4700-4a6c-8ef3-f707f5f5d723 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:30.441303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9126d4ee-4700-4a6c-8ef3-f707f5f5d723 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.442205 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9126d4ee-4700-4a6c-8ef3-f707f5f5d723 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.444087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9126d4ee-4700-4a6c-8ef3-f707f5f5d723 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.445265 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9126d4ee-4700-4a6c-8ef3-f707f5f5d723 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.445753 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9126d4ee-4700-4a6c-8ef3-f707f5f5d723 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.447872 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9126d4ee-4700-4a6c-8ef3-f707f5f5d723 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.634930 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9126d4ee-4700-4a6c-8ef3-f707f5f5d723 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:30.653306 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5fadd3e3-61d5-4ca4-bbf4-f380f9fcd678 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:30.655441 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9126d4ee-4700-4a6c-8ef3-f707f5f5d723 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1427 microversion: 2.1 time: 0.231820 Aug 24 17:51:30.658151 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 146/303] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:30 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1427 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:30.665048 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5fadd3e3-61d5-4ca4-bbf4-f380f9fcd678 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:30.668593 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5fadd3e3-61d5-4ca4-bbf4-f380f9fcd678 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:30.672046 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5fadd3e3-61d5-4ca4-bbf4-f380f9fcd678 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1737 microversion: 2.20 time: 0.309500 Aug 24 17:51:30.674112 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 158/304] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:30 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1737 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:30.680120 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-49af6eae-95dc-4a92-969c-d4fb6e795734 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:30.680120 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-49af6eae-95dc-4a92-969c-d4fb6e795734 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:30.683118 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-49af6eae-95dc-4a92-969c-d4fb6e795734 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.683568 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-49af6eae-95dc-4a92-969c-d4fb6e795734 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.684008 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-49af6eae-95dc-4a92-969c-d4fb6e795734 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.684742 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-49af6eae-95dc-4a92-969c-d4fb6e795734 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.688414 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-49af6eae-95dc-4a92-969c-d4fb6e795734 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.688414 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-49af6eae-95dc-4a92-969c-d4fb6e795734 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.723282 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-940845ec-4f8b-4d77-a981-b8381aa9cab5 req-7db1249d-dc6e-4133-8c4d-d1a92dcb41b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df2b065-5db6-4170-8a4c-be333731546a", "name": "network-vif-deleted", "tag": "fcb60ca7-9589-46e6-97f2-2b78be81320d"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:30.734508 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-940845ec-4f8b-4d77-a981-b8381aa9cab5 req-7db1249d-dc6e-4133-8c4d-d1a92dcb41b9 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.735292 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-940845ec-4f8b-4d77-a981-b8381aa9cab5 req-7db1249d-dc6e-4133-8c4d-d1a92dcb41b9 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.735909 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-940845ec-4f8b-4d77-a981-b8381aa9cab5 req-7db1249d-dc6e-4133-8c4d-d1a92dcb41b9 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.752675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-940845ec-4f8b-4d77-a981-b8381aa9cab5 req-7db1249d-dc6e-4133-8c4d-d1a92dcb41b9 service nova] Creating event network-vif-deleted:fcb60ca7-9589-46e6-97f2-2b78be81320d for instance 1df2b065-5db6-4170-8a4c-be333731546a on hv-cinder-85442 Aug 24 17:51:30.762824 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-940845ec-4f8b-4d77-a981-b8381aa9cab5 req-7db1249d-dc6e-4133-8c4d-d1a92dcb41b9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043394 Aug 24 17:51:30.764429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 159/305] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:51:30.881849 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-49af6eae-95dc-4a92-969c-d4fb6e795734 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:30.899251 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-49af6eae-95dc-4a92-969c-d4fb6e795734 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1366 microversion: 2.1 time: 0.228411 Aug 24 17:51:30.914570 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 147/306] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:30 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:31.166330 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f01c1e91-9e35-4abc-9fff-7b740f54a8de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:31.167733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f01c1e91-9e35-4abc-9fff-7b740f54a8de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:31.177299 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f01c1e91-9e35-4abc-9fff-7b740f54a8de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:31.178241 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f01c1e91-9e35-4abc-9fff-7b740f54a8de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:31.179029 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f01c1e91-9e35-4abc-9fff-7b740f54a8de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:31.179955 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f01c1e91-9e35-4abc-9fff-7b740f54a8de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:31.180481 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f01c1e91-9e35-4abc-9fff-7b740f54a8de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:31.181053 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f01c1e91-9e35-4abc-9fff-7b740f54a8de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:31.356183 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-bcd309f2-cb59-44c5-a7ee-e7a12bcede46 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:31.361456 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-bcd309f2-cb59-44c5-a7ee-e7a12bcede46 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:31.380428 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bcd309f2-cb59-44c5-a7ee-e7a12bcede46 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:31.381526 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bcd309f2-cb59-44c5-a7ee-e7a12bcede46 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:31.382277 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bcd309f2-cb59-44c5-a7ee-e7a12bcede46 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:31.383235 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bcd309f2-cb59-44c5-a7ee-e7a12bcede46 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:31.384263 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bcd309f2-cb59-44c5-a7ee-e7a12bcede46 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:31.384263 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bcd309f2-cb59-44c5-a7ee-e7a12bcede46 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:31.394586 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f01c1e91-9e35-4abc-9fff-7b740f54a8de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:31.407861 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f01c1e91-9e35-4abc-9fff-7b740f54a8de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.245530 Aug 24 17:51:31.422965 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 160/307] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:31 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:31.590470 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-bcd309f2-cb59-44c5-a7ee-e7a12bcede46 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:31.608829 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-bcd309f2-cb59-44c5-a7ee-e7a12bcede46 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1722 microversion: 2.1 time: 0.256333 Aug 24 17:51:31.609686 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 148/308] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:31 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:31.696356 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-c0830dea-117f-4fc7-bd8a-ec0d55567478 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:31.702303 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-c0830dea-117f-4fc7-bd8a-ec0d55567478 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:31.711902 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1b2b8386-b97c-4a66-bcc8-e0df65731783 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:31.716719 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1b2b8386-b97c-4a66-bcc8-e0df65731783 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:31.756943 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1b2b8386-b97c-4a66-bcc8-e0df65731783 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:31.756943 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1b2b8386-b97c-4a66-bcc8-e0df65731783 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:31.758212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c0830dea-117f-4fc7-bd8a-ec0d55567478 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:31.759037 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c0830dea-117f-4fc7-bd8a-ec0d55567478 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:31.759944 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1b2b8386-b97c-4a66-bcc8-e0df65731783 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:31.760785 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c0830dea-117f-4fc7-bd8a-ec0d55567478 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:31.762114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1b2b8386-b97c-4a66-bcc8-e0df65731783 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:31.762729 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c0830dea-117f-4fc7-bd8a-ec0d55567478 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:31.765068 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1b2b8386-b97c-4a66-bcc8-e0df65731783 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:31.765825 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1b2b8386-b97c-4a66-bcc8-e0df65731783 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:31.766490 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c0830dea-117f-4fc7-bd8a-ec0d55567478 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:31.768273 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c0830dea-117f-4fc7-bd8a-ec0d55567478 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:31.938123 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c0830dea-117f-4fc7-bd8a-ec0d55567478 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:31.953725 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-c0830dea-117f-4fc7-bd8a-ec0d55567478 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1299 microversion: 2.1 time: 0.271455 Aug 24 17:51:31.955270 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 161/309] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:31 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1299 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:31.964502 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-73144448-b9e3-4bd3-b3c2-bb6ddd73ed6d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:31.968243 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-73144448-b9e3-4bd3-b3c2-bb6ddd73ed6d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:31.974134 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=2 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:31.981125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-73144448-b9e3-4bd3-b3c2-bb6ddd73ed6d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:31.983526 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-73144448-b9e3-4bd3-b3c2-bb6ddd73ed6d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:31.984570 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-73144448-b9e3-4bd3-b3c2-bb6ddd73ed6d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:31.985953 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-73144448-b9e3-4bd3-b3c2-bb6ddd73ed6d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:31.987030 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-73144448-b9e3-4bd3-b3c2-bb6ddd73ed6d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:31.988175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-73144448-b9e3-4bd3-b3c2-bb6ddd73ed6d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:32.002041 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:32.035471 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1b2b8386-b97c-4a66-bcc8-e0df65731783 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:32.052025 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1b2b8386-b97c-4a66-bcc8-e0df65731783 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:32.053723 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1b2b8386-b97c-4a66-bcc8-e0df65731783 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:32.055082 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1b2b8386-b97c-4a66-bcc8-e0df65731783 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1737 microversion: 2.20 time: 0.352437 Aug 24 17:51:32.056128 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 149/310] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:31 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1737 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:32.231575 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-73144448-b9e3-4bd3-b3c2-bb6ddd73ed6d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:32.249738 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-73144448-b9e3-4bd3-b3c2-bb6ddd73ed6d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1366 microversion: 2.1 time: 0.292311 Aug 24 17:51:32.251285 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 162/311] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:31 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:32.436965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4c02c4fe-d3a1-49dd-8c60-35a1c859f79c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:32.440171 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4c02c4fe-d3a1-49dd-8c60-35a1c859f79c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:32.446117 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4c02c4fe-d3a1-49dd-8c60-35a1c859f79c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:32.446627 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4c02c4fe-d3a1-49dd-8c60-35a1c859f79c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:32.447070 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4c02c4fe-d3a1-49dd-8c60-35a1c859f79c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:32.447781 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4c02c4fe-d3a1-49dd-8c60-35a1c859f79c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:32.448241 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4c02c4fe-d3a1-49dd-8c60-35a1c859f79c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:32.448696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4c02c4fe-d3a1-49dd-8c60-35a1c859f79c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:32.638428 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8c2add58-133f-4183-92c7-e8facebc7bd4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:32.640176 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8c2add58-133f-4183-92c7-e8facebc7bd4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:32.647830 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8c2add58-133f-4183-92c7-e8facebc7bd4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:32.648836 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8c2add58-133f-4183-92c7-e8facebc7bd4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:32.649286 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8c2add58-133f-4183-92c7-e8facebc7bd4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:32.650051 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8c2add58-133f-4183-92c7-e8facebc7bd4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:32.650703 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8c2add58-133f-4183-92c7-e8facebc7bd4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:32.651300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8c2add58-133f-4183-92c7-e8facebc7bd4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:32.663189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-4c02c4fe-d3a1-49dd-8c60-35a1c859f79c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:32.677575 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-4c02c4fe-d3a1-49dd-8c60-35a1c859f79c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.244447 Aug 24 17:51:32.687605 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 150/312] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:32 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:32.789256 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-56c11c17-492c-4c19-9d0d-bd6aaf9a0230 req-27dd912c-8895-4eb7-9d5d-b943659ab7ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e96b5e63-7140-4b8b-99e9-005627134785", "tag": "7f2abfe3-e47f-4067-a51b-0d1eceadb9db"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:32.809404 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-56c11c17-492c-4c19-9d0d-bd6aaf9a0230 req-27dd912c-8895-4eb7-9d5d-b943659ab7ba service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:32.811390 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-56c11c17-492c-4c19-9d0d-bd6aaf9a0230 req-27dd912c-8895-4eb7-9d5d-b943659ab7ba service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:32.812624 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-56c11c17-492c-4c19-9d0d-bd6aaf9a0230 req-27dd912c-8895-4eb7-9d5d-b943659ab7ba service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:32.838597 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-56c11c17-492c-4c19-9d0d-bd6aaf9a0230 req-27dd912c-8895-4eb7-9d5d-b943659ab7ba service nova] Creating event network-changed:7f2abfe3-e47f-4067-a51b-0d1eceadb9db for instance e96b5e63-7140-4b8b-99e9-005627134785 on hv-cinder-85442 Aug 24 17:51:32.846487 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-56c11c17-492c-4c19-9d0d-bd6aaf9a0230 req-27dd912c-8895-4eb7-9d5d-b943659ab7ba service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065098 Aug 24 17:51:32.847362 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 151/313] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:51:32.865127 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8c2add58-133f-4183-92c7-e8facebc7bd4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:32.876335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-8c2add58-133f-4183-92c7-e8facebc7bd4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1722 microversion: 2.1 time: 0.246618 Aug 24 17:51:32.876779 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 163/314] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:32 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:32.981276 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-072c7014-79d3-4b5f-9532-e1b964af75f0 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:32.982708 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-072c7014-79d3-4b5f-9532-e1b964af75f0 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:32.991312 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-072c7014-79d3-4b5f-9532-e1b964af75f0 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:32.991816 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-072c7014-79d3-4b5f-9532-e1b964af75f0 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:32.992257 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-072c7014-79d3-4b5f-9532-e1b964af75f0 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:32.992979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-072c7014-79d3-4b5f-9532-e1b964af75f0 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:32.993887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-072c7014-79d3-4b5f-9532-e1b964af75f0 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:32.994997 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-072c7014-79d3-4b5f-9532-e1b964af75f0 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:33.002247 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=100 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:33.083505 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7c4fd9c6-2e96-4da6-a913-2e09ab241e1a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:33.084578 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7c4fd9c6-2e96-4da6-a913-2e09ab241e1a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:33.089690 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-072c7014-79d3-4b5f-9532-e1b964af75f0 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:33.101773 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-072c7014-79d3-4b5f-9532-e1b964af75f0 tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1299 microversion: 2.1 time: 0.129516 Aug 24 17:51:33.106106 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7c4fd9c6-2e96-4da6-a913-2e09ab241e1a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:33.107544 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7c4fd9c6-2e96-4da6-a913-2e09ab241e1a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:33.107759 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 152/315] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:32 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:33.108397 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7c4fd9c6-2e96-4da6-a913-2e09ab241e1a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:33.109468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7c4fd9c6-2e96-4da6-a913-2e09ab241e1a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:33.110325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7c4fd9c6-2e96-4da6-a913-2e09ab241e1a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:33.110917 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7c4fd9c6-2e96-4da6-a913-2e09ab241e1a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:33.275408 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-6651437c-e0e5-4f9a-8675-14f476e927cd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:33.276342 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-6651437c-e0e5-4f9a-8675-14f476e927cd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:33.296487 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6651437c-e0e5-4f9a-8675-14f476e927cd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:33.297252 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6651437c-e0e5-4f9a-8675-14f476e927cd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:33.298300 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6651437c-e0e5-4f9a-8675-14f476e927cd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:33.299243 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6651437c-e0e5-4f9a-8675-14f476e927cd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:33.299721 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6651437c-e0e5-4f9a-8675-14f476e927cd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:33.300157 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6651437c-e0e5-4f9a-8675-14f476e927cd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:33.357876 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7c4fd9c6-2e96-4da6-a913-2e09ab241e1a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:33.368538 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7c4fd9c6-2e96-4da6-a913-2e09ab241e1a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:33.370480 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7c4fd9c6-2e96-4da6-a913-2e09ab241e1a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:33.371754 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7c4fd9c6-2e96-4da6-a913-2e09ab241e1a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1737 microversion: 2.20 time: 0.296493 Aug 24 17:51:33.372802 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 164/316] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:33 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1737 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:51:33.545937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-4f9e86b7-c120-4fe6-9ecb-9c0101f89b45 req-e7a91f41-9ddf-427f-9718-3984f37556c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "154f9aac-b081-4041-ba41-dd14fb267e29", "name": "network-vif-plugged", "status": "completed", "tag": "12033839-1050-4fb0-90d7-ede010ae619a"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:33.562980 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=20 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:33.565919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-4f9e86b7-c120-4fe6-9ecb-9c0101f89b45 req-e7a91f41-9ddf-427f-9718-3984f37556c8 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:33.566522 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-4f9e86b7-c120-4fe6-9ecb-9c0101f89b45 req-e7a91f41-9ddf-427f-9718-3984f37556c8 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:33.567090 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-4f9e86b7-c120-4fe6-9ecb-9c0101f89b45 req-e7a91f41-9ddf-427f-9718-3984f37556c8 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:33.583205 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-4f9e86b7-c120-4fe6-9ecb-9c0101f89b45 req-e7a91f41-9ddf-427f-9718-3984f37556c8 service nova] Creating event network-vif-plugged:12033839-1050-4fb0-90d7-ede010ae619a for instance 154f9aac-b081-4041-ba41-dd14fb267e29 on hv-cinder-85442 Aug 24 17:51:33.588829 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-4f9e86b7-c120-4fe6-9ecb-9c0101f89b45 req-e7a91f41-9ddf-427f-9718-3984f37556c8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052409 Aug 24 17:51:33.589873 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 165/317] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:51:33.687965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-6651437c-e0e5-4f9a-8675-14f476e927cd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:33.722400 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-6651437c-e0e5-4f9a-8675-14f476e927cd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1366 microversion: 2.1 time: 0.452356 Aug 24 17:51:33.723613 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 153/318] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:33 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1366 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:33.723971 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8a62efdf-780e-4c1a-9f7c-e997391ea080 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:33.725551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8a62efdf-780e-4c1a-9f7c-e997391ea080 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:33.746275 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8a62efdf-780e-4c1a-9f7c-e997391ea080 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:33.746841 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8a62efdf-780e-4c1a-9f7c-e997391ea080 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:33.747628 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8a62efdf-780e-4c1a-9f7c-e997391ea080 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:33.748663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8a62efdf-780e-4c1a-9f7c-e997391ea080 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:33.749316 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8a62efdf-780e-4c1a-9f7c-e997391ea080 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:33.749979 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8a62efdf-780e-4c1a-9f7c-e997391ea080 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:33.903621 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-8ebde719-cdef-4389-a250-1f8180e5c651 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:33.923371 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-8ebde719-cdef-4389-a250-1f8180e5c651 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:33.930402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8ebde719-cdef-4389-a250-1f8180e5c651 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:33.931212 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8ebde719-cdef-4389-a250-1f8180e5c651 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:33.931842 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8ebde719-cdef-4389-a250-1f8180e5c651 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:33.948368 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8ebde719-cdef-4389-a250-1f8180e5c651 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:33.949220 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8ebde719-cdef-4389-a250-1f8180e5c651 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:33.949883 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8ebde719-cdef-4389-a250-1f8180e5c651 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:34.111038 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8a62efdf-780e-4c1a-9f7c-e997391ea080 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:34.154277 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-8a62efdf-780e-4c1a-9f7c-e997391ea080 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.442076 Aug 24 17:51:34.154277 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 166/319] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:33 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:34.172285 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-626aa934-3001-4458-a1c2-5d254ee335fe tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:34.173260 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-626aa934-3001-4458-a1c2-5d254ee335fe tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:34.192398 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-626aa934-3001-4458-a1c2-5d254ee335fe tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:34.197107 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-626aa934-3001-4458-a1c2-5d254ee335fe tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:34.198091 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-626aa934-3001-4458-a1c2-5d254ee335fe tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:34.199139 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-626aa934-3001-4458-a1c2-5d254ee335fe tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:34.201950 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-626aa934-3001-4458-a1c2-5d254ee335fe tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:34.207608 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-626aa934-3001-4458-a1c2-5d254ee335fe tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:34.287277 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-626aa934-3001-4458-a1c2-5d254ee335fe tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:34.289323 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-626aa934-3001-4458-a1c2-5d254ee335fe tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:34.290921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-8ebde719-cdef-4389-a250-1f8180e5c651 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:34.291683 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-626aa934-3001-4458-a1c2-5d254ee335fe tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:34.293085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-626aa934-3001-4458-a1c2-5d254ee335fe tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lazy-loading 'fault' on Instance uuid 1df2b065-5db6-4170-8a4c-be333731546a {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:51:34.301623 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-8ebde719-cdef-4389-a250-1f8180e5c651 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1722 microversion: 2.1 time: 0.404278 Aug 24 17:51:34.305563 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 154/320] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:33 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1722 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:34.393353 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-626aa934-3001-4458-a1c2-5d254ee335fe tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdf1fd67f954cde9ad1334bb93ec4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a770f0caef364853a4033422b76ab918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:34.403636 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1a7c65e6-23c9-429b-9379-1d7087c9c252 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:34.405221 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1a7c65e6-23c9-429b-9379-1d7087c9c252 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:34.406342 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-626aa934-3001-4458-a1c2-5d254ee335fe tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 200 len: 1304 microversion: 2.1 time: 0.253461 Aug 24 17:51:34.407360 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 167/321] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:34 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 1304 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:34.415796 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1a7c65e6-23c9-429b-9379-1d7087c9c252 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:34.416387 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1a7c65e6-23c9-429b-9379-1d7087c9c252 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:34.416837 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1a7c65e6-23c9-429b-9379-1d7087c9c252 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:34.417566 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1a7c65e6-23c9-429b-9379-1d7087c9c252 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:34.418059 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1a7c65e6-23c9-429b-9379-1d7087c9c252 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:34.419194 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1a7c65e6-23c9-429b-9379-1d7087c9c252 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:34.701412 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1a7c65e6-23c9-429b-9379-1d7087c9c252 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:34.723991 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e50633ae-8830-4c59-8d1c-53984a4a6bd6 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-686679933", "imageRef": "2d76d745-abc6-4a7b-b8d7-46566b66934b", "flavorRef": "452", "networks": [{"uuid": "b2faca5a-e8af-4323-908b-3df82d9ff4a6"}]}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:34.725096 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1a7c65e6-23c9-429b-9379-1d7087c9c252 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:34.732208 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1a7c65e6-23c9-429b-9379-1d7087c9c252 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:34.745170 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1a7c65e6-23c9-429b-9379-1d7087c9c252 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1737 microversion: 2.20 time: 0.350316 Aug 24 17:51:34.746140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 155/322] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:34 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1737 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:51:34.770363 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-62b72e59-a997-4194-acb8-43bf328e5a51 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:34.780087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-62b72e59-a997-4194-acb8-43bf328e5a51 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:34.793820 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-62b72e59-a997-4194-acb8-43bf328e5a51 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:34.794872 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-62b72e59-a997-4194-acb8-43bf328e5a51 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:34.796094 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-62b72e59-a997-4194-acb8-43bf328e5a51 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:34.798294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-62b72e59-a997-4194-acb8-43bf328e5a51 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:34.798744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-62b72e59-a997-4194-acb8-43bf328e5a51 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:34.799984 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-62b72e59-a997-4194-acb8-43bf328e5a51 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:34.809395 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.network.neutron [None req-e50633ae-8830-4c59-8d1c-53984a4a6bd6 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] validate_networks() for [('b2faca5a-e8af-4323-908b-3df82d9ff4a6', None, None, None, None, None)] {{(pid=127676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:51:35.116813 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-62b72e59-a997-4194-acb8-43bf328e5a51 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:35.131053 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-62b72e59-a997-4194-acb8-43bf328e5a51 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1366 microversion: 2.1 time: 0.378648 Aug 24 17:51:35.132048 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 156/323] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:34 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:35.189318 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-7b04ee1b-9e3b-470d-8bb2-3282417efffc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:35.189811 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-7b04ee1b-9e3b-470d-8bb2-3282417efffc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:35.196623 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7b04ee1b-9e3b-470d-8bb2-3282417efffc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:35.198147 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7b04ee1b-9e3b-470d-8bb2-3282417efffc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:35.198147 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7b04ee1b-9e3b-470d-8bb2-3282417efffc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:35.198523 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7b04ee1b-9e3b-470d-8bb2-3282417efffc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:35.198780 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7b04ee1b-9e3b-470d-8bb2-3282417efffc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:35.199214 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7b04ee1b-9e3b-470d-8bb2-3282417efffc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:35.431685 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7b04ee1b-9e3b-470d-8bb2-3282417efffc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:35.452155 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-7b04ee1b-9e3b-470d-8bb2-3282417efffc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.264761 Aug 24 17:51:35.452155 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 157/324] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:35 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:35.456745 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-e50633ae-8830-4c59-8d1c-53984a4a6bd6 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Flavor limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:51:35.457670 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-e50633ae-8830-4c59-8d1c-53984a4a6bd6 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Image limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:51:35.459263 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-e50633ae-8830-4c59-8d1c-53984a4a6bd6 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Flavor pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:51:35.459767 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-06415c85-533e-4735-be0c-4de622eb1297 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:35.460724 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-e50633ae-8830-4c59-8d1c-53984a4a6bd6 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Image pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:51:35.461001 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-06415c85-533e-4735-be0c-4de622eb1297 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:35.462553 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-e50633ae-8830-4c59-8d1c-53984a4a6bd6 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:51:35.472271 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-06415c85-533e-4735-be0c-4de622eb1297 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:35.473075 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-06415c85-533e-4735-be0c-4de622eb1297 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:35.473828 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-06415c85-533e-4735-be0c-4de622eb1297 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:35.475108 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-06415c85-533e-4735-be0c-4de622eb1297 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:35.475880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-06415c85-533e-4735-be0c-4de622eb1297 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:35.476599 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-06415c85-533e-4735-be0c-4de622eb1297 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:35.478320 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:35.497325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e50633ae-8830-4c59-8d1c-53984a4a6bd6 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:35.497325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e50633ae-8830-4c59-8d1c-53984a4a6bd6 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:35.497325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e50633ae-8830-4c59-8d1c-53984a4a6bd6 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:35.500031 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e50633ae-8830-4c59-8d1c-53984a4a6bd6 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:35.500031 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e50633ae-8830-4c59-8d1c-53984a4a6bd6 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:35.500031 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e50633ae-8830-4c59-8d1c-53984a4a6bd6 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:35.534798 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-e50633ae-8830-4c59-8d1c-53984a4a6bd6 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Getting quotas for project 4fa9fd072c704af2950a9bb4339d374d. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:51:35.539861 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-e50633ae-8830-4c59-8d1c-53984a4a6bd6 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Getting quotas for user 7ca82f3632bc404691835a2db6167939 and project 4fa9fd072c704af2950a9bb4339d374d. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:51:35.566995 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e50633ae-8830-4c59-8d1c-53984a4a6bd6 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Going to run 1 instances... {{(pid=127676) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:51:35.572562 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e50633ae-8830-4c59-8d1c-53984a4a6bd6 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d76d745-abc6-4a7b-b8d7-46566b66934b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:51:35.716901 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-06415c85-533e-4735-be0c-4de622eb1297 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:35.727661 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-06415c85-533e-4735-be0c-4de622eb1297 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1722 microversion: 2.1 time: 0.273978 Aug 24 17:51:35.729201 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 158/325] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:35 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:35.735311 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ef9ce29f-28ae-4113-a68b-0ad3501c535f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:35.736619 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ef9ce29f-28ae-4113-a68b-0ad3501c535f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] [instance: 1df2b065-5db6-4170-8a4c-be333731546a] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:35.758248 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ef9ce29f-28ae-4113-a68b-0ad3501c535f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:35.758800 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ef9ce29f-28ae-4113-a68b-0ad3501c535f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:35.759322 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ef9ce29f-28ae-4113-a68b-0ad3501c535f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:35.760064 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ef9ce29f-28ae-4113-a68b-0ad3501c535f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:35.760531 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ef9ce29f-28ae-4113-a68b-0ad3501c535f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:35.760962 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ef9ce29f-28ae-4113-a68b-0ad3501c535f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:35.779946 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-ef9ce29f-28ae-4113-a68b-0ad3501c535f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] HTTP exception thrown: Instance 1df2b065-5db6-4170-8a4c-be333731546a could not be found. Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ef9ce29f-28ae-4113-a68b-0ad3501c535f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Request method failure captured: Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a HTTP/1.1 Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmULGRZ6gHZRs1or_Csviqhwn08NCYlo-7HmJtTM8xUtIIpbOoqwEyDeOPv_saaC37jeLSnvaBdTRgGlMTcEZiU_FajAU5whSUUrqOny4URfCEKoqhg9ekjzd2_ZXQQu3PnmxEpehkejpZRjRdqTwwVlYMw-3xAfeuAqzFOAe3xVslc Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: a770f0caef364853a4033422b76ab918 Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-VolumesNegativeTest-1472084474 Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:51:35.781546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:51:35.784748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/a770f0caef364853a4033422b76ab918"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a770f0caef364853a4033422b76ab918"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_a770f0caef364853a4033422b76ab918", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/a770f0caef364853a4033422b76ab918"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:51:35.784748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-VolumesNegativeTest-1472084474 Aug 24 17:51:35.784748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: a770f0caef364853a4033422b76ab918 Aug 24 17:51:35.784748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-VolumesNegativeTest-1472084474 Aug 24 17:51:35.784748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-VolumesNegativeTest-1472084474-project Aug 24 17:51:35.784748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:51:35.784748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:51:35.784748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: bfdf1fd67f954cde9ad1334bb93ec4e6 Aug 24 17:51:35.784748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-VolumesNegativeTest-1472084474-project Aug 24 17:51:35.784748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:51:35.784748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance 1df2b065-5db6-4170-8a4c-be333731546a could not be found. Aug 24 17:51:35.784748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': '1df2b065-5db6-4170-8a4c-be333731546a'} Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1df2b065-5db6-4170-8a4c-be333731546a could not be found. Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:51:35.786453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:51:35.790188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:51:35.790188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:51:35.790188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:51:35.790188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:51:35.790188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:51:35.790188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:51:35.790188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:51:35.790188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1df2b065-5db6-4170-8a4c-be333731546a could not be found. Aug 24 17:51:35.790188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:51:35.790188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:35.790188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:51:35.790188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:35.790188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:35.790188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:35.790188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:51:35.790188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:51:35.790188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1df2b065-5db6-4170-8a4c-be333731546a could not be found. Aug 24 17:51:35.790188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:51:35.793359 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ef9ce29f-28ae-4113-a68b-0ad3501c535f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] Returning 404 to user: Instance 1df2b065-5db6-4170-8a4c-be333731546a could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:51:35.793359 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ef9ce29f-28ae-4113-a68b-0ad3501c535f tempest-VolumesNegativeTest-1472084474 tempest-VolumesNegativeTest-1472084474-project] 10.222.0.76 "GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a" status: 404 len: 111 microversion: 2.1 time: 0.052599 Aug 24 17:51:35.793359 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 159/326] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:35 2022] GET /compute/v2.1/servers/1df2b065-5db6-4170-8a4c-be333731546a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:51:35.796064 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-5e8a3047-8432-4922-8b26-b037bf9aab1b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:35.796064 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-5e8a3047-8432-4922-8b26-b037bf9aab1b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:35.811217 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5e8a3047-8432-4922-8b26-b037bf9aab1b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:35.811217 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5e8a3047-8432-4922-8b26-b037bf9aab1b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:35.811217 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5e8a3047-8432-4922-8b26-b037bf9aab1b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:35.817256 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5e8a3047-8432-4922-8b26-b037bf9aab1b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:35.817256 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5e8a3047-8432-4922-8b26-b037bf9aab1b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:35.817256 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5e8a3047-8432-4922-8b26-b037bf9aab1b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:35.853237 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e50633ae-8830-4c59-8d1c-53984a4a6bd6 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.134474 Aug 24 17:51:35.855107 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 168/327] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 17:51:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:51:35.882353 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-edad3596-73c9-405c-b8d8-afd155eb494f tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:35.885613 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-edad3596-73c9-405c-b8d8-afd155eb494f tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:36.066116 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-edad3596-73c9-405c-b8d8-afd155eb494f tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:36.108124 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-edad3596-73c9-405c-b8d8-afd155eb494f tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1218 microversion: 2.1 time: 0.221804 Aug 24 17:51:36.117553 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 169/328] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:35 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1218 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:36.141640 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5e8a3047-8432-4922-8b26-b037bf9aab1b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:36.172191 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ab34cb8d-82c8-40f0-b091-59f50973143b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:36.173336 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-ab34cb8d-82c8-40f0-b091-59f50973143b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:36.198541 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5e8a3047-8432-4922-8b26-b037bf9aab1b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:36.210145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ab34cb8d-82c8-40f0-b091-59f50973143b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:36.211386 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ab34cb8d-82c8-40f0-b091-59f50973143b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:36.212122 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5e8a3047-8432-4922-8b26-b037bf9aab1b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:36.213999 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ab34cb8d-82c8-40f0-b091-59f50973143b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:36.218832 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-5e8a3047-8432-4922-8b26-b037bf9aab1b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1737 microversion: 2.20 time: 0.429336 Aug 24 17:51:36.219062 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ab34cb8d-82c8-40f0-b091-59f50973143b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:36.219217 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 160/329] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:35 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1737 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:36.219374 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ab34cb8d-82c8-40f0-b091-59f50973143b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:36.219972 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ab34cb8d-82c8-40f0-b091-59f50973143b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:36.429723 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-ab34cb8d-82c8-40f0-b091-59f50973143b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:36.443876 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-ab34cb8d-82c8-40f0-b091-59f50973143b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1366 microversion: 2.1 time: 0.280299 Aug 24 17:51:36.451288 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 170/330] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:36 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:36.481662 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1bb8660d-5113-4f2e-bd94-2f45625c3b06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:36.484215 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1bb8660d-5113-4f2e-bd94-2f45625c3b06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:36.496366 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1bb8660d-5113-4f2e-bd94-2f45625c3b06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:36.497221 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1bb8660d-5113-4f2e-bd94-2f45625c3b06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:36.498672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1bb8660d-5113-4f2e-bd94-2f45625c3b06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:36.500818 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1bb8660d-5113-4f2e-bd94-2f45625c3b06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:36.503253 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1bb8660d-5113-4f2e-bd94-2f45625c3b06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:36.507788 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1bb8660d-5113-4f2e-bd94-2f45625c3b06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:36.752978 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-36d871b2-6117-410e-a88a-20cd7c48d4ec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:36.753624 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-36d871b2-6117-410e-a88a-20cd7c48d4ec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:36.789199 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-36d871b2-6117-410e-a88a-20cd7c48d4ec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:36.789199 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-36d871b2-6117-410e-a88a-20cd7c48d4ec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:36.789199 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-36d871b2-6117-410e-a88a-20cd7c48d4ec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:36.789199 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-36d871b2-6117-410e-a88a-20cd7c48d4ec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:36.789716 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-36d871b2-6117-410e-a88a-20cd7c48d4ec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:36.790297 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-36d871b2-6117-410e-a88a-20cd7c48d4ec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:36.819482 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1bb8660d-5113-4f2e-bd94-2f45625c3b06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:36.871210 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1bb8660d-5113-4f2e-bd94-2f45625c3b06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.369765 Aug 24 17:51:36.875888 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 161/331] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:36 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:37.104428 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-36d871b2-6117-410e-a88a-20cd7c48d4ec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:37.121308 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-36d871b2-6117-410e-a88a-20cd7c48d4ec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1722 microversion: 2.1 time: 0.373690 Aug 24 17:51:37.123270 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 171/332] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:36 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1722 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:37.181194 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ccd44599-894e-4fa6-b786-531d64730fda tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:37.183343 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ccd44599-894e-4fa6-b786-531d64730fda tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:37.260773 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-c679d3c2-baaf-44de-ab35-f03cbcb7ff00 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:37.261775 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-c679d3c2-baaf-44de-ab35-f03cbcb7ff00 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:37.277228 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c679d3c2-baaf-44de-ab35-f03cbcb7ff00 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:37.277826 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c679d3c2-baaf-44de-ab35-f03cbcb7ff00 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:37.282790 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c679d3c2-baaf-44de-ab35-f03cbcb7ff00 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:37.283987 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c679d3c2-baaf-44de-ab35-f03cbcb7ff00 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:37.284770 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c679d3c2-baaf-44de-ab35-f03cbcb7ff00 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:37.286772 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c679d3c2-baaf-44de-ab35-f03cbcb7ff00 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:37.379939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-ccd44599-894e-4fa6-b786-531d64730fda tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:37.397748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ccd44599-894e-4fa6-b786-531d64730fda tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1218 microversion: 2.1 time: 0.239181 Aug 24 17:51:37.420732 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 162/333] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:37 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1218 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:37.479545 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-463fb764-d706-4adc-a547-b7ec771a16f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:37.486136 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-463fb764-d706-4adc-a547-b7ec771a16f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:37.516878 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-463fb764-d706-4adc-a547-b7ec771a16f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:37.517760 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-463fb764-d706-4adc-a547-b7ec771a16f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:37.522635 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-463fb764-d706-4adc-a547-b7ec771a16f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:37.524487 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-463fb764-d706-4adc-a547-b7ec771a16f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:37.525385 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-463fb764-d706-4adc-a547-b7ec771a16f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:37.526251 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-463fb764-d706-4adc-a547-b7ec771a16f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:37.587893 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c679d3c2-baaf-44de-ab35-f03cbcb7ff00 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:37.600304 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c679d3c2-baaf-44de-ab35-f03cbcb7ff00 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:37.604769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c679d3c2-baaf-44de-ab35-f03cbcb7ff00 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:37.605987 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-c679d3c2-baaf-44de-ab35-f03cbcb7ff00 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1737 microversion: 2.20 time: 0.349198 Aug 24 17:51:37.621988 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 172/334] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:37 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1737 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:51:37.835088 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-463fb764-d706-4adc-a547-b7ec771a16f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:37.860977 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-463fb764-d706-4adc-a547-b7ec771a16f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1366 microversion: 2.1 time: 0.388228 Aug 24 17:51:37.877901 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 163/335] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:37 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1366 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:37.896620 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-541664b7-4127-4406-8621-1c0212c9a534 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:37.897425 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-541664b7-4127-4406-8621-1c0212c9a534 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:37.921910 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-541664b7-4127-4406-8621-1c0212c9a534 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:37.922108 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-541664b7-4127-4406-8621-1c0212c9a534 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:37.922556 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-541664b7-4127-4406-8621-1c0212c9a534 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:37.923320 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-541664b7-4127-4406-8621-1c0212c9a534 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:37.923788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-541664b7-4127-4406-8621-1c0212c9a534 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:37.924224 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-541664b7-4127-4406-8621-1c0212c9a534 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:38.095250 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-541664b7-4127-4406-8621-1c0212c9a534 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:38.105016 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-541664b7-4127-4406-8621-1c0212c9a534 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.212300 Aug 24 17:51:38.120099 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 173/336] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:37 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:38.148883 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-78a076e1-b358-462e-ab5d-bdd1721d4fcc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:38.158846 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-78a076e1-b358-462e-ab5d-bdd1721d4fcc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:38.185238 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-78a076e1-b358-462e-ab5d-bdd1721d4fcc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:38.187438 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-78a076e1-b358-462e-ab5d-bdd1721d4fcc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:38.187438 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-78a076e1-b358-462e-ab5d-bdd1721d4fcc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:38.198598 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-78a076e1-b358-462e-ab5d-bdd1721d4fcc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:38.205731 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-78a076e1-b358-462e-ab5d-bdd1721d4fcc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:38.209712 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-78a076e1-b358-462e-ab5d-bdd1721d4fcc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:38.443077 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-686d5eba-d1cd-4840-b8da-b5fe2d6c9944 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:38.443703 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-686d5eba-d1cd-4840-b8da-b5fe2d6c9944 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:38.459664 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-686d5eba-d1cd-4840-b8da-b5fe2d6c9944 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:38.462388 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-686d5eba-d1cd-4840-b8da-b5fe2d6c9944 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:38.468384 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-686d5eba-d1cd-4840-b8da-b5fe2d6c9944 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:38.468384 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-686d5eba-d1cd-4840-b8da-b5fe2d6c9944 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:38.468384 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-686d5eba-d1cd-4840-b8da-b5fe2d6c9944 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:38.471971 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-78a076e1-b358-462e-ab5d-bdd1721d4fcc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:38.484975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-686d5eba-d1cd-4840-b8da-b5fe2d6c9944 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:38.486030 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-78a076e1-b358-462e-ab5d-bdd1721d4fcc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1722 microversion: 2.1 time: 0.343550 Aug 24 17:51:38.488166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 164/337] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:38 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1722 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:38.586528 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-686d5eba-d1cd-4840-b8da-b5fe2d6c9944 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:38.600404 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-686d5eba-d1cd-4840-b8da-b5fe2d6c9944 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1270 microversion: 2.1 time: 0.161422 Aug 24 17:51:38.610137 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 174/338] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:38 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:38.653206 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-bac16f3d-6725-4d15-b612-ca05c0a0155c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:38.658210 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-bac16f3d-6725-4d15-b612-ca05c0a0155c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:38.675935 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bac16f3d-6725-4d15-b612-ca05c0a0155c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:38.677568 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bac16f3d-6725-4d15-b612-ca05c0a0155c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:38.678300 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bac16f3d-6725-4d15-b612-ca05c0a0155c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:38.679734 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bac16f3d-6725-4d15-b612-ca05c0a0155c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:38.680552 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bac16f3d-6725-4d15-b612-ca05c0a0155c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:38.681376 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bac16f3d-6725-4d15-b612-ca05c0a0155c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:38.894722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-bac16f3d-6725-4d15-b612-ca05c0a0155c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:38.900816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d7bfa70b-b9ff-469e-a5e6-f42af68395d1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:38.904582 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d7bfa70b-b9ff-469e-a5e6-f42af68395d1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:38.916562 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-bac16f3d-6725-4d15-b612-ca05c0a0155c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:38.918401 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d7bfa70b-b9ff-469e-a5e6-f42af68395d1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:38.919685 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d7bfa70b-b9ff-469e-a5e6-f42af68395d1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:38.922648 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d7bfa70b-b9ff-469e-a5e6-f42af68395d1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:38.923790 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d7bfa70b-b9ff-469e-a5e6-f42af68395d1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:38.924009 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-bac16f3d-6725-4d15-b612-ca05c0a0155c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:38.926348 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d7bfa70b-b9ff-469e-a5e6-f42af68395d1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:38.927285 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-bac16f3d-6725-4d15-b612-ca05c0a0155c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1737 microversion: 2.20 time: 0.279679 Aug 24 17:51:38.927998 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d7bfa70b-b9ff-469e-a5e6-f42af68395d1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:38.930249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 165/339] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:38 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1737 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:51:39.128411 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f2f5f9cd-29f3-474f-b374-51bea32252e0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:39.129415 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-f2f5f9cd-29f3-474f-b374-51bea32252e0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:39.141332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d7bfa70b-b9ff-469e-a5e6-f42af68395d1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:39.153351 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d7bfa70b-b9ff-469e-a5e6-f42af68395d1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1366 microversion: 2.1 time: 0.256657 Aug 24 17:51:39.155614 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 175/340] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:38 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:39.164336 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f2f5f9cd-29f3-474f-b374-51bea32252e0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:39.166731 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f2f5f9cd-29f3-474f-b374-51bea32252e0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:39.167483 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f2f5f9cd-29f3-474f-b374-51bea32252e0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:39.170381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f2f5f9cd-29f3-474f-b374-51bea32252e0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:39.172374 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f2f5f9cd-29f3-474f-b374-51bea32252e0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:39.176604 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f2f5f9cd-29f3-474f-b374-51bea32252e0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:39.394683 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f2f5f9cd-29f3-474f-b374-51bea32252e0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:39.412166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-f2f5f9cd-29f3-474f-b374-51bea32252e0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.287498 Aug 24 17:51:39.426023 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 166/341] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:39 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:39.536655 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-9bac6bba-6294-4dd7-920b-9087c4a52ea9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:39.538302 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-9bac6bba-6294-4dd7-920b-9087c4a52ea9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:39.547203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9bac6bba-6294-4dd7-920b-9087c4a52ea9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:39.547788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9bac6bba-6294-4dd7-920b-9087c4a52ea9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:39.548299 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9bac6bba-6294-4dd7-920b-9087c4a52ea9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:39.549054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9bac6bba-6294-4dd7-920b-9087c4a52ea9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:39.549515 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9bac6bba-6294-4dd7-920b-9087c4a52ea9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:39.549954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9bac6bba-6294-4dd7-920b-9087c4a52ea9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:39.631802 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ef3c93e3-b51b-49dc-a858-89d7dbfc8bde tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:39.633283 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ef3c93e3-b51b-49dc-a858-89d7dbfc8bde tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:39.644705 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ef3c93e3-b51b-49dc-a858-89d7dbfc8bde tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:39.645607 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ef3c93e3-b51b-49dc-a858-89d7dbfc8bde tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:39.646446 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ef3c93e3-b51b-49dc-a858-89d7dbfc8bde tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:39.647678 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ef3c93e3-b51b-49dc-a858-89d7dbfc8bde tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:39.648499 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ef3c93e3-b51b-49dc-a858-89d7dbfc8bde tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:39.649527 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ef3c93e3-b51b-49dc-a858-89d7dbfc8bde tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:39.733808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-9bac6bba-6294-4dd7-920b-9087c4a52ea9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:39.752600 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-9bac6bba-6294-4dd7-920b-9087c4a52ea9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1722 microversion: 2.1 time: 0.222055 Aug 24 17:51:39.772737 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 176/342] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:39 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:39.812955 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-ef3c93e3-b51b-49dc-a858-89d7dbfc8bde tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:39.821755 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ef3c93e3-b51b-49dc-a858-89d7dbfc8bde tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1270 microversion: 2.1 time: 0.195130 Aug 24 17:51:39.835930 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 167/343] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:39 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1270 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:39.991198 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f898fcb7-a7f2-4646-aecd-8b3fad38b776 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:39.994911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f898fcb7-a7f2-4646-aecd-8b3fad38b776 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:40.009197 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f898fcb7-a7f2-4646-aecd-8b3fad38b776 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:40.011114 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f898fcb7-a7f2-4646-aecd-8b3fad38b776 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:40.011340 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f898fcb7-a7f2-4646-aecd-8b3fad38b776 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:40.012042 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f898fcb7-a7f2-4646-aecd-8b3fad38b776 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:40.012635 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f898fcb7-a7f2-4646-aecd-8b3fad38b776 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:40.014138 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f898fcb7-a7f2-4646-aecd-8b3fad38b776 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:40.195663 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-858e12fd-1311-4238-95aa-26598f67c2a3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:40.195663 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-858e12fd-1311-4238-95aa-26598f67c2a3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:40.196773 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-858e12fd-1311-4238-95aa-26598f67c2a3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:40.197277 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-858e12fd-1311-4238-95aa-26598f67c2a3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:40.197719 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-858e12fd-1311-4238-95aa-26598f67c2a3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:40.198471 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-858e12fd-1311-4238-95aa-26598f67c2a3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:40.198932 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-858e12fd-1311-4238-95aa-26598f67c2a3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:40.200174 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-858e12fd-1311-4238-95aa-26598f67c2a3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:40.649189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-858e12fd-1311-4238-95aa-26598f67c2a3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:40.667457 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f898fcb7-a7f2-4646-aecd-8b3fad38b776 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:40.675928 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-858e12fd-1311-4238-95aa-26598f67c2a3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1366 microversion: 2.1 time: 0.487765 Aug 24 17:51:40.680894 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 168/344] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:40 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1366 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:40.687272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f898fcb7-a7f2-4646-aecd-8b3fad38b776 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:40.697786 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c98d8391-83a6-440c-85c7-b864e1b5ae95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:40.699614 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f898fcb7-a7f2-4646-aecd-8b3fad38b776 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:40.700940 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c98d8391-83a6-440c-85c7-b864e1b5ae95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:40.705200 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f898fcb7-a7f2-4646-aecd-8b3fad38b776 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1737 microversion: 2.20 time: 0.727424 Aug 24 17:51:40.705200 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 177/345] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:39 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1737 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:51:40.745140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c98d8391-83a6-440c-85c7-b864e1b5ae95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:40.746120 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c98d8391-83a6-440c-85c7-b864e1b5ae95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:40.746268 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c98d8391-83a6-440c-85c7-b864e1b5ae95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:40.748968 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c98d8391-83a6-440c-85c7-b864e1b5ae95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:40.749573 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c98d8391-83a6-440c-85c7-b864e1b5ae95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:40.750092 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c98d8391-83a6-440c-85c7-b864e1b5ae95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:40.798403 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-648fa53a-de23-49dc-9e09-4102ae38f614 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:40.799363 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-648fa53a-de23-49dc-9e09-4102ae38f614 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:40.809067 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-648fa53a-de23-49dc-9e09-4102ae38f614 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:40.810594 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-648fa53a-de23-49dc-9e09-4102ae38f614 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:40.811771 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-648fa53a-de23-49dc-9e09-4102ae38f614 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:40.813354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-648fa53a-de23-49dc-9e09-4102ae38f614 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:40.814237 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-648fa53a-de23-49dc-9e09-4102ae38f614 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:40.815078 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-648fa53a-de23-49dc-9e09-4102ae38f614 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:41.098219 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c98d8391-83a6-440c-85c7-b864e1b5ae95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:41.110647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c98d8391-83a6-440c-85c7-b864e1b5ae95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.428326 Aug 24 17:51:41.111274 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 169/346] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:40 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:41.126406 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a8c3a951-f780-4656-ba2e-e631e8112970 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:41.127028 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a8c3a951-f780-4656-ba2e-e631e8112970 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:41.133681 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a8c3a951-f780-4656-ba2e-e631e8112970 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:41.134965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a8c3a951-f780-4656-ba2e-e631e8112970 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:41.135510 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a8c3a951-f780-4656-ba2e-e631e8112970 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:41.136266 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a8c3a951-f780-4656-ba2e-e631e8112970 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:41.136742 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a8c3a951-f780-4656-ba2e-e631e8112970 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:41.137178 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a8c3a951-f780-4656-ba2e-e631e8112970 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:41.176943 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=100 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:41.197334 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-648fa53a-de23-49dc-9e09-4102ae38f614 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:41.208545 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-648fa53a-de23-49dc-9e09-4102ae38f614 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1722 microversion: 2.1 time: 0.416563 Aug 24 17:51:41.222489 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 178/347] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:40 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1722 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:41.236961 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a8c3a951-f780-4656-ba2e-e631e8112970 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:41.245609 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a8c3a951-f780-4656-ba2e-e631e8112970 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1276 microversion: 2.1 time: 0.130500 Aug 24 17:51:41.246289 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 170/348] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:41 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1276 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:41.703322 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-40826d11-c233-47e7-8cef-2003e6b694e6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:41.704892 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-40826d11-c233-47e7-8cef-2003e6b694e6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:41.710477 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-40826d11-c233-47e7-8cef-2003e6b694e6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:41.710965 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-40826d11-c233-47e7-8cef-2003e6b694e6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:41.711397 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-40826d11-c233-47e7-8cef-2003e6b694e6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:41.712108 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-40826d11-c233-47e7-8cef-2003e6b694e6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:41.712727 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-40826d11-c233-47e7-8cef-2003e6b694e6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:41.713157 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-40826d11-c233-47e7-8cef-2003e6b694e6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:41.739795 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-26c9d8c0-0906-40a7-ab07-474542ce34fa tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:41.740415 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-26c9d8c0-0906-40a7-ab07-474542ce34fa tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:41.758153 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-26c9d8c0-0906-40a7-ab07-474542ce34fa tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:41.758622 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-26c9d8c0-0906-40a7-ab07-474542ce34fa tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:41.759076 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-26c9d8c0-0906-40a7-ab07-474542ce34fa tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:41.759837 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-26c9d8c0-0906-40a7-ab07-474542ce34fa tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:41.760302 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-26c9d8c0-0906-40a7-ab07-474542ce34fa tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:41.760736 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-26c9d8c0-0906-40a7-ab07-474542ce34fa tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:42.477112 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-40826d11-c233-47e7-8cef-2003e6b694e6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:42.504225 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-40826d11-c233-47e7-8cef-2003e6b694e6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1366 microversion: 2.1 time: 0.791559 Aug 24 17:51:42.505557 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 179/349] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:41 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1366 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:42.550623 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-a9b2ff4a-1c4d-4415-955b-6e1ce528e814 req-8556b686-6546-49ed-a709-680c163bbbfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e96b5e63-7140-4b8b-99e9-005627134785", "name": "network-vif-plugged", "status": "completed", "tag": "7f2abfe3-e47f-4067-a51b-0d1eceadb9db"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:42.584633 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-26c9d8c0-0906-40a7-ab07-474542ce34fa tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:42.597744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-a9b2ff4a-1c4d-4415-955b-6e1ce528e814 req-8556b686-6546-49ed-a709-680c163bbbfb service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:42.598267 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-a9b2ff4a-1c4d-4415-955b-6e1ce528e814 req-8556b686-6546-49ed-a709-680c163bbbfb service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:42.598965 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-a9b2ff4a-1c4d-4415-955b-6e1ce528e814 req-8556b686-6546-49ed-a709-680c163bbbfb service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:42.614513 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-26c9d8c0-0906-40a7-ab07-474542ce34fa tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:42.619405 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-26c9d8c0-0906-40a7-ab07-474542ce34fa tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:42.626094 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-26c9d8c0-0906-40a7-ab07-474542ce34fa tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1737 microversion: 2.20 time: 0.891017 Aug 24 17:51:42.629466 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 171/350] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:41 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1737 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:42.642350 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-a9b2ff4a-1c4d-4415-955b-6e1ce528e814 req-8556b686-6546-49ed-a709-680c163bbbfb service nova] Creating event network-vif-plugged:7f2abfe3-e47f-4067-a51b-0d1eceadb9db for instance e96b5e63-7140-4b8b-99e9-005627134785 on hv-cinder-85442 Aug 24 17:51:42.649606 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f717ad19-44a3-45c4-b887-5df8a711d918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:42.655984 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-f717ad19-44a3-45c4-b887-5df8a711d918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:42.660248 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-a9b2ff4a-1c4d-4415-955b-6e1ce528e814 req-8556b686-6546-49ed-a709-680c163bbbfb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145802 Aug 24 17:51:42.663648 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 180/351] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:42.670285 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8bcc5d56-a3fb-4a7e-9f2b-9b2c8ea8f342 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:42.671072 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8bcc5d56-a3fb-4a7e-9f2b-9b2c8ea8f342 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:42.686377 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f717ad19-44a3-45c4-b887-5df8a711d918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:42.690996 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f717ad19-44a3-45c4-b887-5df8a711d918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:42.691218 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8bcc5d56-a3fb-4a7e-9f2b-9b2c8ea8f342 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:42.692507 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8bcc5d56-a3fb-4a7e-9f2b-9b2c8ea8f342 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:42.693039 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8bcc5d56-a3fb-4a7e-9f2b-9b2c8ea8f342 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:42.693594 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f717ad19-44a3-45c4-b887-5df8a711d918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:42.693791 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8bcc5d56-a3fb-4a7e-9f2b-9b2c8ea8f342 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:42.695414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8bcc5d56-a3fb-4a7e-9f2b-9b2c8ea8f342 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:42.695863 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8bcc5d56-a3fb-4a7e-9f2b-9b2c8ea8f342 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:42.696756 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f717ad19-44a3-45c4-b887-5df8a711d918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:42.698007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f717ad19-44a3-45c4-b887-5df8a711d918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:42.699254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f717ad19-44a3-45c4-b887-5df8a711d918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:42.764625 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=100 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:43.074776 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8bcc5d56-a3fb-4a7e-9f2b-9b2c8ea8f342 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:43.114266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-8bcc5d56-a3fb-4a7e-9f2b-9b2c8ea8f342 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1699 microversion: 2.1 time: 0.446258 Aug 24 17:51:43.121263 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 181/352] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:42 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1699 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:43.179731 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-4f6bf4a5-746c-4884-bd2f-99e1f2793dab tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:43.180995 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4f6bf4a5-746c-4884-bd2f-99e1f2793dab tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:43.210331 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4f6bf4a5-746c-4884-bd2f-99e1f2793dab tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:43.215563 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4f6bf4a5-746c-4884-bd2f-99e1f2793dab tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:43.216574 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4f6bf4a5-746c-4884-bd2f-99e1f2793dab tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:43.225075 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4f6bf4a5-746c-4884-bd2f-99e1f2793dab tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:43.227254 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4f6bf4a5-746c-4884-bd2f-99e1f2793dab tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:43.228528 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4f6bf4a5-746c-4884-bd2f-99e1f2793dab tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:43.563977 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f717ad19-44a3-45c4-b887-5df8a711d918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:43.605233 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-f717ad19-44a3-45c4-b887-5df8a711d918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.963291 Aug 24 17:51:43.620161 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 172/353] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:42 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:43.636848 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-99ee646a-db55-4d6e-a4b9-12e0c07227b5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:43.665709 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-99ee646a-db55-4d6e-a4b9-12e0c07227b5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:43.666490 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-99ee646a-db55-4d6e-a4b9-12e0c07227b5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:43.667304 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-99ee646a-db55-4d6e-a4b9-12e0c07227b5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:43.767499 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-99ee646a-db55-4d6e-a4b9-12e0c07227b5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Going to try to start instance {{(pid=127677) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 17:51:43.771065 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-4f6bf4a5-746c-4884-bd2f-99e1f2793dab tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:43.790577 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-4f6bf4a5-746c-4884-bd2f-99e1f2793dab tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1318 microversion: 2.1 time: 0.652683 Aug 24 17:51:43.802212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 182/354] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:43 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1318 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:43.817577 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0eceabc6-34cf-44b2-82d3-e53a07ba8251 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:43.818274 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0eceabc6-34cf-44b2-82d3-e53a07ba8251 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:43.835860 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0eceabc6-34cf-44b2-82d3-e53a07ba8251 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:43.836335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0eceabc6-34cf-44b2-82d3-e53a07ba8251 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:43.839615 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0eceabc6-34cf-44b2-82d3-e53a07ba8251 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:43.842754 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0eceabc6-34cf-44b2-82d3-e53a07ba8251 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:43.843470 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0eceabc6-34cf-44b2-82d3-e53a07ba8251 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:43.847205 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0eceabc6-34cf-44b2-82d3-e53a07ba8251 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:44.158181 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-99ee646a-db55-4d6e-a4b9-12e0c07227b5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "POST /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f/action" status: 202 len: 0 microversion: 2.1 time: 0.537650 Aug 24 17:51:44.159622 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 173/355] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 17:51:43 2022] POST /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:51:44.172253 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d0e815f5-bd84-4b13-815f-8153210ba300 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:44.174159 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d0e815f5-bd84-4b13-815f-8153210ba300 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:44.194668 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d0e815f5-bd84-4b13-815f-8153210ba300 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:44.195582 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d0e815f5-bd84-4b13-815f-8153210ba300 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:44.196423 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d0e815f5-bd84-4b13-815f-8153210ba300 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:44.210613 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d0e815f5-bd84-4b13-815f-8153210ba300 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:44.211573 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d0e815f5-bd84-4b13-815f-8153210ba300 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:44.212291 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d0e815f5-bd84-4b13-815f-8153210ba300 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:44.275142 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0eceabc6-34cf-44b2-82d3-e53a07ba8251 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:44.294609 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0eceabc6-34cf-44b2-82d3-e53a07ba8251 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1366 microversion: 2.1 time: 0.493326 Aug 24 17:51:44.310375 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 183/356] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:43 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1366 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:44.319890 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-325192ca-8ac6-4c54-baba-8955622aa851 req-2600732f-0e94-4d5e-a9e4-58fa0433bf1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134fa9aa-ee04-40f4-807a-57429a1b55fd", "tag": "4ef448d4-f3c6-4482-a435-e54d91528c44"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:44.332739 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-325192ca-8ac6-4c54-baba-8955622aa851 req-2600732f-0e94-4d5e-a9e4-58fa0433bf1c service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:44.333566 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-325192ca-8ac6-4c54-baba-8955622aa851 req-2600732f-0e94-4d5e-a9e4-58fa0433bf1c service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:44.334492 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-325192ca-8ac6-4c54-baba-8955622aa851 req-2600732f-0e94-4d5e-a9e4-58fa0433bf1c service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:44.362829 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-325192ca-8ac6-4c54-baba-8955622aa851 req-2600732f-0e94-4d5e-a9e4-58fa0433bf1c service nova] Creating event network-changed:4ef448d4-f3c6-4482-a435-e54d91528c44 for instance 134fa9aa-ee04-40f4-807a-57429a1b55fd on hv-cinder-85442 Aug 24 17:51:44.373163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-325192ca-8ac6-4c54-baba-8955622aa851 req-2600732f-0e94-4d5e-a9e4-58fa0433bf1c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060801 Aug 24 17:51:44.376877 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 184/357] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:44.383163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d9d12043-2bc9-49f2-8af1-be3be3f077c8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:44.384167 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d9d12043-2bc9-49f2-8af1-be3be3f077c8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:44.391483 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d9d12043-2bc9-49f2-8af1-be3be3f077c8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:44.392281 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d9d12043-2bc9-49f2-8af1-be3be3f077c8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:44.392898 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d9d12043-2bc9-49f2-8af1-be3be3f077c8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:44.393961 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d9d12043-2bc9-49f2-8af1-be3be3f077c8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:44.394638 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d9d12043-2bc9-49f2-8af1-be3be3f077c8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:44.395238 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d9d12043-2bc9-49f2-8af1-be3be3f077c8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:44.642926 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d0e815f5-bd84-4b13-815f-8153210ba300 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:44.681351 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d0e815f5-bd84-4b13-815f-8153210ba300 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:44.683452 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d0e815f5-bd84-4b13-815f-8153210ba300 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:44.685294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d0e815f5-bd84-4b13-815f-8153210ba300 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1737 microversion: 2.20 time: 0.523320 Aug 24 17:51:44.686538 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 174/358] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:44 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1737 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:44.701923 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d9d12043-2bc9-49f2-8af1-be3be3f077c8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:44.704706 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-fda8df82-0664-4d36-aa04-3d2b855aa2be tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:44.706091 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-fda8df82-0664-4d36-aa04-3d2b855aa2be tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:44.714091 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d9d12043-2bc9-49f2-8af1-be3be3f077c8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1708 microversion: 2.1 time: 0.335574 Aug 24 17:51:44.726283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 185/359] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:44 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1708 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:44.740194 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fda8df82-0664-4d36-aa04-3d2b855aa2be tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:44.742997 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fda8df82-0664-4d36-aa04-3d2b855aa2be tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:44.750117 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fda8df82-0664-4d36-aa04-3d2b855aa2be tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:44.750117 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fda8df82-0664-4d36-aa04-3d2b855aa2be tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:44.750117 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fda8df82-0664-4d36-aa04-3d2b855aa2be tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:44.750117 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fda8df82-0664-4d36-aa04-3d2b855aa2be tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:44.831431 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-6753a323-8aa5-41f9-9e02-83914463382f tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:44.842363 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-6753a323-8aa5-41f9-9e02-83914463382f tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:44.881218 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6753a323-8aa5-41f9-9e02-83914463382f tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:44.882625 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6753a323-8aa5-41f9-9e02-83914463382f tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:44.883827 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6753a323-8aa5-41f9-9e02-83914463382f tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:44.887132 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6753a323-8aa5-41f9-9e02-83914463382f tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:44.889112 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6753a323-8aa5-41f9-9e02-83914463382f tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:44.890711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6753a323-8aa5-41f9-9e02-83914463382f tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:45.050231 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-fda8df82-0664-4d36-aa04-3d2b855aa2be tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:45.066511 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-fda8df82-0664-4d36-aa04-3d2b855aa2be tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.376056 Aug 24 17:51:45.067606 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 175/360] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:44 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:45.199881 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-6753a323-8aa5-41f9-9e02-83914463382f tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:45.214263 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-6753a323-8aa5-41f9-9e02-83914463382f tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1318 microversion: 2.1 time: 0.391536 Aug 24 17:51:45.215350 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 186/361] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:44 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:45.339632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ffa3288b-0d27-47ea-938d-1c15729d8149 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:45.340777 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ffa3288b-0d27-47ea-938d-1c15729d8149 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:45.363369 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ffa3288b-0d27-47ea-938d-1c15729d8149 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:45.368607 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ffa3288b-0d27-47ea-938d-1c15729d8149 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:45.369389 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ffa3288b-0d27-47ea-938d-1c15729d8149 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:45.370794 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ffa3288b-0d27-47ea-938d-1c15729d8149 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:45.371404 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ffa3288b-0d27-47ea-938d-1c15729d8149 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:45.386644 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ffa3288b-0d27-47ea-938d-1c15729d8149 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:45.719533 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-ffa3288b-0d27-47ea-938d-1c15729d8149 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:45.733482 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ffa3288b-0d27-47ea-938d-1c15729d8149 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1557 microversion: 2.1 time: 0.415486 Aug 24 17:51:45.744956 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 176/362] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:45 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1557 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:45.747070 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0c446dd1-1711-4e9e-9e40-e920991cf9e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:45.748004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0c446dd1-1711-4e9e-9e40-e920991cf9e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:45.752802 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f659cb92-a4ba-4904-ae23-efd97d4ba15e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:45.754922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=2 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:45.760534 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-f659cb92-a4ba-4904-ae23-efd97d4ba15e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:45.767651 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c446dd1-1711-4e9e-9e40-e920991cf9e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:45.768548 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c446dd1-1711-4e9e-9e40-e920991cf9e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:45.769272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c446dd1-1711-4e9e-9e40-e920991cf9e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:45.770094 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c446dd1-1711-4e9e-9e40-e920991cf9e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:45.771175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c446dd1-1711-4e9e-9e40-e920991cf9e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:45.771780 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c446dd1-1711-4e9e-9e40-e920991cf9e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:45.774353 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f659cb92-a4ba-4904-ae23-efd97d4ba15e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:45.774952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f659cb92-a4ba-4904-ae23-efd97d4ba15e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:45.775491 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f659cb92-a4ba-4904-ae23-efd97d4ba15e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:45.776738 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f659cb92-a4ba-4904-ae23-efd97d4ba15e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:45.777598 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f659cb92-a4ba-4904-ae23-efd97d4ba15e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:45.778940 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f659cb92-a4ba-4904-ae23-efd97d4ba15e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:46.084396 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=8 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:46.154086 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0c446dd1-1711-4e9e-9e40-e920991cf9e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:46.171666 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0c446dd1-1711-4e9e-9e40-e920991cf9e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:46.176344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0c446dd1-1711-4e9e-9e40-e920991cf9e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:46.181221 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0c446dd1-1711-4e9e-9e40-e920991cf9e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1737 microversion: 2.20 time: 0.439292 Aug 24 17:51:46.182082 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f659cb92-a4ba-4904-ae23-efd97d4ba15e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:46.192528 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 187/363] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:45 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1737 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:46.208193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b163e479-effd-4b67-a1f0-589775dcfdf8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:46.209056 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-b163e479-effd-4b67-a1f0-589775dcfdf8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:46.215184 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-f659cb92-a4ba-4904-ae23-efd97d4ba15e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1708 microversion: 2.1 time: 0.464729 Aug 24 17:51:46.215184 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 177/364] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:45 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1708 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:46.221447 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b163e479-effd-4b67-a1f0-589775dcfdf8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:46.222623 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-812b38f6-3c2b-4b5e-b340-b1fb22557b24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:46.222978 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b163e479-effd-4b67-a1f0-589775dcfdf8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:46.223860 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b163e479-effd-4b67-a1f0-589775dcfdf8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:46.224572 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-812b38f6-3c2b-4b5e-b340-b1fb22557b24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:46.225350 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b163e479-effd-4b67-a1f0-589775dcfdf8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:46.226369 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b163e479-effd-4b67-a1f0-589775dcfdf8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:46.227286 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b163e479-effd-4b67-a1f0-589775dcfdf8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:46.251703 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-812b38f6-3c2b-4b5e-b340-b1fb22557b24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:46.252412 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-812b38f6-3c2b-4b5e-b340-b1fb22557b24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:46.252955 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-812b38f6-3c2b-4b5e-b340-b1fb22557b24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:46.253813 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-812b38f6-3c2b-4b5e-b340-b1fb22557b24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:46.254441 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-812b38f6-3c2b-4b5e-b340-b1fb22557b24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:46.255117 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-812b38f6-3c2b-4b5e-b340-b1fb22557b24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:46.374403 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b163e479-effd-4b67-a1f0-589775dcfdf8 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.172541 Aug 24 17:51:46.375215 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 188/365] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 24 17:51:46 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:46.416927 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-4a7d4b74-2e52-4a7e-8acd-e443b9bfc0ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:46.416927 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4a7d4b74-2e52-4a7e-8acd-e443b9bfc0ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:46.451192 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4a7d4b74-2e52-4a7e-8acd-e443b9bfc0ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:46.451192 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4a7d4b74-2e52-4a7e-8acd-e443b9bfc0ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:46.451192 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4a7d4b74-2e52-4a7e-8acd-e443b9bfc0ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:46.451192 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4a7d4b74-2e52-4a7e-8acd-e443b9bfc0ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:46.452162 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4a7d4b74-2e52-4a7e-8acd-e443b9bfc0ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:46.452162 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4a7d4b74-2e52-4a7e-8acd-e443b9bfc0ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:46.693426 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-812b38f6-3c2b-4b5e-b340-b1fb22557b24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:46.717996 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-812b38f6-3c2b-4b5e-b340-b1fb22557b24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.504080 Aug 24 17:51:46.719926 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 178/366] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:46 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:46.860997 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-4a7d4b74-2e52-4a7e-8acd-e443b9bfc0ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:46.884634 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-4a7d4b74-2e52-4a7e-8acd-e443b9bfc0ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1318 microversion: 2.1 time: 0.493384 Aug 24 17:51:46.899800 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 189/367] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:46 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:47.224145 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3af26b42-0c54-4430-b307-cbfcc023d7ba tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:47.224791 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3af26b42-0c54-4430-b307-cbfcc023d7ba tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:47.237473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3af26b42-0c54-4430-b307-cbfcc023d7ba tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:47.238268 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3af26b42-0c54-4430-b307-cbfcc023d7ba tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:47.239283 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3af26b42-0c54-4430-b307-cbfcc023d7ba tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:47.240879 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3af26b42-0c54-4430-b307-cbfcc023d7ba tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:47.242189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3af26b42-0c54-4430-b307-cbfcc023d7ba tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:47.246552 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3af26b42-0c54-4430-b307-cbfcc023d7ba tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:47.253309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-3e4eda1d-206c-4335-a823-4c5ce23112df tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:47.257054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-3e4eda1d-206c-4335-a823-4c5ce23112df tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:47.305151 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3e4eda1d-206c-4335-a823-4c5ce23112df tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:47.308385 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3e4eda1d-206c-4335-a823-4c5ce23112df tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:47.320314 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3e4eda1d-206c-4335-a823-4c5ce23112df tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:47.320314 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3e4eda1d-206c-4335-a823-4c5ce23112df tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:47.326492 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3e4eda1d-206c-4335-a823-4c5ce23112df tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:47.328557 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3e4eda1d-206c-4335-a823-4c5ce23112df tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:47.396374 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=2 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:47.561600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3af26b42-0c54-4430-b307-cbfcc023d7ba tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:47.578291 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-3e4eda1d-206c-4335-a823-4c5ce23112df tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:47.583178 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3af26b42-0c54-4430-b307-cbfcc023d7ba tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:47.586503 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3af26b42-0c54-4430-b307-cbfcc023d7ba tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:47.588261 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3af26b42-0c54-4430-b307-cbfcc023d7ba tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1737 microversion: 2.20 time: 0.368171 Aug 24 17:51:47.589045 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 179/368] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:47 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1737 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:51:47.599973 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-3e4eda1d-206c-4335-a823-4c5ce23112df tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1708 microversion: 2.1 time: 0.362826 Aug 24 17:51:47.609287 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 190/369] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:47 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1708 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:47.774854 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0867aa9f-f0b1-43af-8c3d-bf297c0ab347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:47.776439 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0867aa9f-f0b1-43af-8c3d-bf297c0ab347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:47.788473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0867aa9f-f0b1-43af-8c3d-bf297c0ab347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:47.790156 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0867aa9f-f0b1-43af-8c3d-bf297c0ab347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:47.791463 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0867aa9f-f0b1-43af-8c3d-bf297c0ab347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:47.792717 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0867aa9f-f0b1-43af-8c3d-bf297c0ab347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:47.793485 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0867aa9f-f0b1-43af-8c3d-bf297c0ab347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:47.795085 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0867aa9f-f0b1-43af-8c3d-bf297c0ab347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:47.930373 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-affae7b9-851e-4259-9c41-a203e0d16f28 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:47.931525 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-affae7b9-851e-4259-9c41-a203e0d16f28 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:47.942418 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-affae7b9-851e-4259-9c41-a203e0d16f28 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:47.943576 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-affae7b9-851e-4259-9c41-a203e0d16f28 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:47.944517 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-affae7b9-851e-4259-9c41-a203e0d16f28 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:47.945924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-affae7b9-851e-4259-9c41-a203e0d16f28 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:47.946902 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-affae7b9-851e-4259-9c41-a203e0d16f28 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:47.947752 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-affae7b9-851e-4259-9c41-a203e0d16f28 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:48.147463 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0867aa9f-f0b1-43af-8c3d-bf297c0ab347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:48.164974 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0867aa9f-f0b1-43af-8c3d-bf297c0ab347 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.401018 Aug 24 17:51:48.180057 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 180/370] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:47 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:48.218489 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-affae7b9-851e-4259-9c41-a203e0d16f28 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:48.230161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-affae7b9-851e-4259-9c41-a203e0d16f28 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1318 microversion: 2.1 time: 0.306518 Aug 24 17:51:48.231859 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 191/371] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:47 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:48.376600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-1d2155db-3fa5-452f-8e0f-3ee077a2aebf req-03ed42a7-687c-46b9-9a3c-8a07d9db4d3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e96b5e63-7140-4b8b-99e9-005627134785", "tag": "7f2abfe3-e47f-4067-a51b-0d1eceadb9db"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:48.394265 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-1d2155db-3fa5-452f-8e0f-3ee077a2aebf req-03ed42a7-687c-46b9-9a3c-8a07d9db4d3f service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:48.395460 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-1d2155db-3fa5-452f-8e0f-3ee077a2aebf req-03ed42a7-687c-46b9-9a3c-8a07d9db4d3f service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:48.396058 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-1d2155db-3fa5-452f-8e0f-3ee077a2aebf req-03ed42a7-687c-46b9-9a3c-8a07d9db4d3f service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:48.414475 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-1d2155db-3fa5-452f-8e0f-3ee077a2aebf req-03ed42a7-687c-46b9-9a3c-8a07d9db4d3f service nova] Creating event network-changed:7f2abfe3-e47f-4067-a51b-0d1eceadb9db for instance e96b5e63-7140-4b8b-99e9-005627134785 on hv-cinder-85442 Aug 24 17:51:48.422531 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-1d2155db-3fa5-452f-8e0f-3ee077a2aebf req-03ed42a7-687c-46b9-9a3c-8a07d9db4d3f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051956 Aug 24 17:51:48.424073 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 181/372] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:48.628352 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ac46ec3f-75e7-44dc-a250-5dd7b6be266b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:48.629953 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-ac46ec3f-75e7-44dc-a250-5dd7b6be266b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:48.634640 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-90873eb7-769b-4fd8-be3b-2b6c40a48114 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:48.637080 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-90873eb7-769b-4fd8-be3b-2b6c40a48114 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:48.641446 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ac46ec3f-75e7-44dc-a250-5dd7b6be266b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:48.642700 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ac46ec3f-75e7-44dc-a250-5dd7b6be266b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:48.644613 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ac46ec3f-75e7-44dc-a250-5dd7b6be266b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:48.646372 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ac46ec3f-75e7-44dc-a250-5dd7b6be266b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:48.647405 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ac46ec3f-75e7-44dc-a250-5dd7b6be266b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:48.648689 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ac46ec3f-75e7-44dc-a250-5dd7b6be266b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:48.650654 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90873eb7-769b-4fd8-be3b-2b6c40a48114 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:48.652608 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90873eb7-769b-4fd8-be3b-2b6c40a48114 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:48.653156 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90873eb7-769b-4fd8-be3b-2b6c40a48114 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:48.660189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90873eb7-769b-4fd8-be3b-2b6c40a48114 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:48.660792 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90873eb7-769b-4fd8-be3b-2b6c40a48114 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:48.661250 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90873eb7-769b-4fd8-be3b-2b6c40a48114 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:49.130543 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-ac46ec3f-75e7-44dc-a250-5dd7b6be266b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:49.157457 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-ac46ec3f-75e7-44dc-a250-5dd7b6be266b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1708 microversion: 2.1 time: 0.533167 Aug 24 17:51:49.158913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 192/373] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:48 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1708 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:49.189454 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-90873eb7-769b-4fd8-be3b-2b6c40a48114 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:49.207137 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-3aeaad96-08d3-40fd-8ef8-c0be488c451f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:49.209116 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-3aeaad96-08d3-40fd-8ef8-c0be488c451f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:49.220099 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-90873eb7-769b-4fd8-be3b-2b6c40a48114 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:49.224837 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3aeaad96-08d3-40fd-8ef8-c0be488c451f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:49.226273 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3aeaad96-08d3-40fd-8ef8-c0be488c451f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:49.227532 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-90873eb7-769b-4fd8-be3b-2b6c40a48114 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:49.228169 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3aeaad96-08d3-40fd-8ef8-c0be488c451f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:49.230434 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3aeaad96-08d3-40fd-8ef8-c0be488c451f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:49.232267 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3aeaad96-08d3-40fd-8ef8-c0be488c451f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:49.234693 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3aeaad96-08d3-40fd-8ef8-c0be488c451f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:49.238031 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-90873eb7-769b-4fd8-be3b-2b6c40a48114 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1737 microversion: 2.20 time: 0.609075 Aug 24 17:51:49.238648 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 182/374] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:48 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1737 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:51:49.271576 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-b04c095c-f32a-43df-8a19-8656fef4bcf7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:49.275436 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-b04c095c-f32a-43df-8a19-8656fef4bcf7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:49.310960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b04c095c-f32a-43df-8a19-8656fef4bcf7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:49.312418 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b04c095c-f32a-43df-8a19-8656fef4bcf7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:49.314243 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b04c095c-f32a-43df-8a19-8656fef4bcf7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:49.319486 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b04c095c-f32a-43df-8a19-8656fef4bcf7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:49.322353 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b04c095c-f32a-43df-8a19-8656fef4bcf7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:49.323417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b04c095c-f32a-43df-8a19-8656fef4bcf7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:49.570921 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-3aeaad96-08d3-40fd-8ef8-c0be488c451f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:49.580398 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-3aeaad96-08d3-40fd-8ef8-c0be488c451f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.382639 Aug 24 17:51:49.583957 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 193/375] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:49 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:49.696154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-b04c095c-f32a-43df-8a19-8656fef4bcf7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:49.719844 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-b04c095c-f32a-43df-8a19-8656fef4bcf7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1318 microversion: 2.1 time: 0.462041 Aug 24 17:51:49.730971 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 183/376] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:49 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:50.208554 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e294863b-24df-4816-a51e-1ffe071a73b8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:50.213415 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e294863b-24df-4816-a51e-1ffe071a73b8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:50.232384 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e294863b-24df-4816-a51e-1ffe071a73b8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:50.232384 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e294863b-24df-4816-a51e-1ffe071a73b8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:50.235340 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e294863b-24df-4816-a51e-1ffe071a73b8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:50.237289 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e294863b-24df-4816-a51e-1ffe071a73b8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:50.243032 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e294863b-24df-4816-a51e-1ffe071a73b8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:50.244176 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e294863b-24df-4816-a51e-1ffe071a73b8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:50.273587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0c1a9699-bedb-469c-b912-9ca34389d1f1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:50.277913 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0c1a9699-bedb-469c-b912-9ca34389d1f1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:50.314943 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0c1a9699-bedb-469c-b912-9ca34389d1f1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:50.315811 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0c1a9699-bedb-469c-b912-9ca34389d1f1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:50.316615 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0c1a9699-bedb-469c-b912-9ca34389d1f1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:50.323219 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0c1a9699-bedb-469c-b912-9ca34389d1f1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:50.324073 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0c1a9699-bedb-469c-b912-9ca34389d1f1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:50.327018 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0c1a9699-bedb-469c-b912-9ca34389d1f1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:50.629782 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e294863b-24df-4816-a51e-1ffe071a73b8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:50.643788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e294863b-24df-4816-a51e-1ffe071a73b8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1712 microversion: 2.1 time: 0.454705 Aug 24 17:51:50.644381 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 194/377] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:50 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1712 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:50.648540 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0c1a9699-bedb-469c-b912-9ca34389d1f1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:50.652262 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a7cea549-e962-4e29-aae9-417e7dbab8f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:50.652925 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a7cea549-e962-4e29-aae9-417e7dbab8f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:50.660638 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a7cea549-e962-4e29-aae9-417e7dbab8f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:50.661139 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a7cea549-e962-4e29-aae9-417e7dbab8f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:50.661678 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a7cea549-e962-4e29-aae9-417e7dbab8f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:50.662449 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a7cea549-e962-4e29-aae9-417e7dbab8f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:50.663079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a7cea549-e962-4e29-aae9-417e7dbab8f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:50.663710 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a7cea549-e962-4e29-aae9-417e7dbab8f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:50.672437 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0c1a9699-bedb-469c-b912-9ca34389d1f1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:50.678087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0c1a9699-bedb-469c-b912-9ca34389d1f1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:50.681658 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0c1a9699-bedb-469c-b912-9ca34389d1f1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1719 microversion: 2.20 time: 0.419789 Aug 24 17:51:50.695475 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 184/378] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:50 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1719 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:50.759457 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-6e846ff5-3a09-4fa2-ac73-085f3c5a1a3a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:50.760329 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-6e846ff5-3a09-4fa2-ac73-085f3c5a1a3a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:50.773173 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6e846ff5-3a09-4fa2-ac73-085f3c5a1a3a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:50.776228 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6e846ff5-3a09-4fa2-ac73-085f3c5a1a3a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:50.777032 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6e846ff5-3a09-4fa2-ac73-085f3c5a1a3a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:50.778836 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6e846ff5-3a09-4fa2-ac73-085f3c5a1a3a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:50.781580 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6e846ff5-3a09-4fa2-ac73-085f3c5a1a3a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:50.782295 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6e846ff5-3a09-4fa2-ac73-085f3c5a1a3a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:51.144991 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a7cea549-e962-4e29-aae9-417e7dbab8f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:51.160150 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a7cea549-e962-4e29-aae9-417e7dbab8f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1521 microversion: 2.1 time: 0.514331 Aug 24 17:51:51.160990 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 195/379] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:50 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1521 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:51.185154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-6e846ff5-3a09-4fa2-ac73-085f3c5a1a3a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:51.194492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-6e846ff5-3a09-4fa2-ac73-085f3c5a1a3a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1318 microversion: 2.1 time: 0.439900 Aug 24 17:51:51.195835 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 185/380] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:50 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1318 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:51.722531 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-3ae045dc-af0d-4f7c-8f24-15c64bbf95de tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:51.723934 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-3ae045dc-af0d-4f7c-8f24-15c64bbf95de tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:51.730883 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3ae045dc-af0d-4f7c-8f24-15c64bbf95de tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:51.731614 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3ae045dc-af0d-4f7c-8f24-15c64bbf95de tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:51.732061 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3ae045dc-af0d-4f7c-8f24-15c64bbf95de tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:51.733110 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3ae045dc-af0d-4f7c-8f24-15c64bbf95de tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:51.733661 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3ae045dc-af0d-4f7c-8f24-15c64bbf95de tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:51.734427 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3ae045dc-af0d-4f7c-8f24-15c64bbf95de tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:51.988552 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-1b7893bc-15b0-4f94-8405-61c8e0f94d71 req-5f2906f4-1477-4481-b126-4419011ff5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134fa9aa-ee04-40f4-807a-57429a1b55fd", "name": "network-vif-plugged", "status": "completed", "tag": "4ef448d4-f3c6-4482-a435-e54d91528c44"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:52.000238 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-1b7893bc-15b0-4f94-8405-61c8e0f94d71 req-5f2906f4-1477-4481-b126-4419011ff5d4 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:52.001121 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-1b7893bc-15b0-4f94-8405-61c8e0f94d71 req-5f2906f4-1477-4481-b126-4419011ff5d4 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:52.001648 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-1b7893bc-15b0-4f94-8405-61c8e0f94d71 req-5f2906f4-1477-4481-b126-4419011ff5d4 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:52.015063 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-1b7893bc-15b0-4f94-8405-61c8e0f94d71 req-5f2906f4-1477-4481-b126-4419011ff5d4 service nova] Creating event network-vif-plugged:4ef448d4-f3c6-4482-a435-e54d91528c44 for instance 134fa9aa-ee04-40f4-807a-57429a1b55fd on hv-cinder-85442 Aug 24 17:51:52.021010 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-1b7893bc-15b0-4f94-8405-61c8e0f94d71 req-5f2906f4-1477-4481-b126-4419011ff5d4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035954 Aug 24 17:51:52.022253 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 186/381] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:51:52.051138 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-3ae045dc-af0d-4f7c-8f24-15c64bbf95de tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:52.068714 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-3ae045dc-af0d-4f7c-8f24-15c64bbf95de tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:52.072649 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-3ae045dc-af0d-4f7c-8f24-15c64bbf95de tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:52.075262 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-3ae045dc-af0d-4f7c-8f24-15c64bbf95de tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1719 microversion: 2.20 time: 0.356614 Aug 24 17:51:52.077144 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 196/382] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:51 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1719 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:52.186616 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-66026ac5-405c-4f1d-a9e8-3d195a7b699b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:52.187415 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-66026ac5-405c-4f1d-a9e8-3d195a7b699b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:52.195596 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-66026ac5-405c-4f1d-a9e8-3d195a7b699b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:52.196097 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-66026ac5-405c-4f1d-a9e8-3d195a7b699b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:52.196541 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-66026ac5-405c-4f1d-a9e8-3d195a7b699b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:52.197298 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-66026ac5-405c-4f1d-a9e8-3d195a7b699b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:52.197965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-66026ac5-405c-4f1d-a9e8-3d195a7b699b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:52.198459 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-66026ac5-405c-4f1d-a9e8-3d195a7b699b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:52.219280 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d7d488e8-8c27-4d48-800e-d97be3b2366d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:52.220266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d7d488e8-8c27-4d48-800e-d97be3b2366d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:52.223454 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:52.228695 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d7d488e8-8c27-4d48-800e-d97be3b2366d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:52.229302 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d7d488e8-8c27-4d48-800e-d97be3b2366d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:52.229844 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d7d488e8-8c27-4d48-800e-d97be3b2366d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:52.250699 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d7d488e8-8c27-4d48-800e-d97be3b2366d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:52.251208 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d7d488e8-8c27-4d48-800e-d97be3b2366d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:52.251963 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d7d488e8-8c27-4d48-800e-d97be3b2366d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:52.588126 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-66026ac5-405c-4f1d-a9e8-3d195a7b699b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:52.598788 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-66026ac5-405c-4f1d-a9e8-3d195a7b699b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1501 microversion: 2.1 time: 0.418683 Aug 24 17:51:52.599706 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 187/383] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:52 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1501 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:52.615590 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d7d488e8-8c27-4d48-800e-d97be3b2366d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:52.628327 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d7d488e8-8c27-4d48-800e-d97be3b2366d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1318 microversion: 2.1 time: 0.413327 Aug 24 17:51:52.628834 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 197/384] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:52 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:52.633685 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9ce7e8bc-7e9d-4819-9cf0-86e1df84b008 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:52.634867 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9ce7e8bc-7e9d-4819-9cf0-86e1df84b008 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:52.646574 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9ce7e8bc-7e9d-4819-9cf0-86e1df84b008 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:52.647617 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9ce7e8bc-7e9d-4819-9cf0-86e1df84b008 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:52.648393 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9ce7e8bc-7e9d-4819-9cf0-86e1df84b008 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:52.649967 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9ce7e8bc-7e9d-4819-9cf0-86e1df84b008 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:52.651464 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9ce7e8bc-7e9d-4819-9cf0-86e1df84b008 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:52.652675 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9ce7e8bc-7e9d-4819-9cf0-86e1df84b008 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:52.926537 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9ce7e8bc-7e9d-4819-9cf0-86e1df84b008 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:52.938959 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9ce7e8bc-7e9d-4819-9cf0-86e1df84b008 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1515 microversion: 2.1 time: 0.312761 Aug 24 17:51:52.942078 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 188/385] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:52 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1515 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:53.107979 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-13ffbc08-4571-4329-84c1-7b14d7642bed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:53.109689 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-13ffbc08-4571-4329-84c1-7b14d7642bed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:53.117823 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-13ffbc08-4571-4329-84c1-7b14d7642bed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:53.118736 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-13ffbc08-4571-4329-84c1-7b14d7642bed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:53.119181 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-13ffbc08-4571-4329-84c1-7b14d7642bed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:53.119911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-13ffbc08-4571-4329-84c1-7b14d7642bed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:53.120374 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-13ffbc08-4571-4329-84c1-7b14d7642bed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:53.120869 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-13ffbc08-4571-4329-84c1-7b14d7642bed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:53.342499 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-13ffbc08-4571-4329-84c1-7b14d7642bed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:53.352066 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-13ffbc08-4571-4329-84c1-7b14d7642bed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:53.353660 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-13ffbc08-4571-4329-84c1-7b14d7642bed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:53.354974 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-13ffbc08-4571-4329-84c1-7b14d7642bed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1719 microversion: 2.20 time: 0.258730 Aug 24 17:51:53.355535 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 198/386] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:53 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1719 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:53.650704 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c4157af3-48ec-4724-a64e-8b5e1db9e055 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:53.654968 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c4157af3-48ec-4724-a64e-8b5e1db9e055 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:53.660075 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c4157af3-48ec-4724-a64e-8b5e1db9e055 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:53.660581 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c4157af3-48ec-4724-a64e-8b5e1db9e055 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:53.661126 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c4157af3-48ec-4724-a64e-8b5e1db9e055 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:53.661875 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c4157af3-48ec-4724-a64e-8b5e1db9e055 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:53.662339 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c4157af3-48ec-4724-a64e-8b5e1db9e055 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:53.662761 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c4157af3-48ec-4724-a64e-8b5e1db9e055 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:53.833521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c4157af3-48ec-4724-a64e-8b5e1db9e055 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:53.843504 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c4157af3-48ec-4724-a64e-8b5e1db9e055 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1318 microversion: 2.1 time: 0.196953 Aug 24 17:51:53.844117 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 189/387] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:53 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:54.045397 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-b88137f7-6d12-4b9d-806f-67b34140a5a9 req-81fdb157-43b3-4fd1-8347-c9491da67282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "154f9aac-b081-4041-ba41-dd14fb267e29", "name": "network-vif-unplugged", "status": "completed", "tag": "12033839-1050-4fb0-90d7-ede010ae619a"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:54.058328 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-b88137f7-6d12-4b9d-806f-67b34140a5a9 req-81fdb157-43b3-4fd1-8347-c9491da67282 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:54.059671 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-b88137f7-6d12-4b9d-806f-67b34140a5a9 req-81fdb157-43b3-4fd1-8347-c9491da67282 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:54.060499 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-b88137f7-6d12-4b9d-806f-67b34140a5a9 req-81fdb157-43b3-4fd1-8347-c9491da67282 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:54.068176 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=100 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:54.080922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-b88137f7-6d12-4b9d-806f-67b34140a5a9 req-81fdb157-43b3-4fd1-8347-c9491da67282 service nova] Creating event network-vif-unplugged:12033839-1050-4fb0-90d7-ede010ae619a for instance 154f9aac-b081-4041-ba41-dd14fb267e29 on hv-cinder-85442 Aug 24 17:51:54.089212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-b88137f7-6d12-4b9d-806f-67b34140a5a9 req-81fdb157-43b3-4fd1-8347-c9491da67282 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049418 Aug 24 17:51:54.089822 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 199/388] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:51:54.395309 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-aa8b10e2-f877-422e-8a25-8345adf13a28 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:54.397335 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-aa8b10e2-f877-422e-8a25-8345adf13a28 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:54.407526 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=100 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:54.416434 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-aa8b10e2-f877-422e-8a25-8345adf13a28 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:54.420720 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-aa8b10e2-f877-422e-8a25-8345adf13a28 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:54.421926 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-aa8b10e2-f877-422e-8a25-8345adf13a28 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:54.425262 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-aa8b10e2-f877-422e-8a25-8345adf13a28 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:54.427172 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-aa8b10e2-f877-422e-8a25-8345adf13a28 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:54.430002 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-aa8b10e2-f877-422e-8a25-8345adf13a28 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:54.717582 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-aa8b10e2-f877-422e-8a25-8345adf13a28 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:54.736391 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-aa8b10e2-f877-422e-8a25-8345adf13a28 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:54.739454 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-aa8b10e2-f877-422e-8a25-8345adf13a28 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:54.742440 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-aa8b10e2-f877-422e-8a25-8345adf13a28 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1719 microversion: 2.20 time: 0.360677 Aug 24 17:51:54.761928 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 190/389] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:54 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1719 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:54.874724 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-46cd196c-4c00-423d-b164-fd8fd1a8e2ff tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:54.875888 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-46cd196c-4c00-423d-b164-fd8fd1a8e2ff tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:54.888919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-46cd196c-4c00-423d-b164-fd8fd1a8e2ff tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:54.890215 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-46cd196c-4c00-423d-b164-fd8fd1a8e2ff tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:54.892375 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-46cd196c-4c00-423d-b164-fd8fd1a8e2ff tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:54.894142 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-46cd196c-4c00-423d-b164-fd8fd1a8e2ff tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:54.895290 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-46cd196c-4c00-423d-b164-fd8fd1a8e2ff tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:54.896332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-46cd196c-4c00-423d-b164-fd8fd1a8e2ff tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:55.166529 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-46cd196c-4c00-423d-b164-fd8fd1a8e2ff tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:55.178263 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-46cd196c-4c00-423d-b164-fd8fd1a8e2ff tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1318 microversion: 2.1 time: 0.312978 Aug 24 17:51:55.181577 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 200/390] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:54 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:55.372486 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-8f5d61b1-c8e3-438e-8bff-4ca197b4e171 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:55.374880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-8f5d61b1-c8e3-438e-8bff-4ca197b4e171 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:55.395366 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8f5d61b1-c8e3-438e-8bff-4ca197b4e171 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:55.396114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8f5d61b1-c8e3-438e-8bff-4ca197b4e171 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:55.396725 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8f5d61b1-c8e3-438e-8bff-4ca197b4e171 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:55.397728 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8f5d61b1-c8e3-438e-8bff-4ca197b4e171 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:55.398702 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8f5d61b1-c8e3-438e-8bff-4ca197b4e171 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:55.399390 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8f5d61b1-c8e3-438e-8bff-4ca197b4e171 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:55.427691 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-8f5d61b1-c8e3-438e-8bff-4ca197b4e171 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lazy-loading 'flavor' on Instance uuid 4ec18342-3f45-401f-ba1a-768a427a5fa2 {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:51:55.784969 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a3351dfc-70c0-489b-8107-5ebd2830cddf tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:55.787453 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a3351dfc-70c0-489b-8107-5ebd2830cddf tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:55.816884 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a3351dfc-70c0-489b-8107-5ebd2830cddf tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:55.818119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a3351dfc-70c0-489b-8107-5ebd2830cddf tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:55.819469 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a3351dfc-70c0-489b-8107-5ebd2830cddf tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:55.829505 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a3351dfc-70c0-489b-8107-5ebd2830cddf tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:55.831313 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a3351dfc-70c0-489b-8107-5ebd2830cddf tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:55.832383 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a3351dfc-70c0-489b-8107-5ebd2830cddf tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:55.943251 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-8f5d61b1-c8e3-438e-8bff-4ca197b4e171 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "POST /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2/action" status: 200 len: 32 microversion: 2.1 time: 0.571899 Aug 24 17:51:55.943251 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 191/391] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 17:51:55 2022] POST /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2/action => generated 32 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:51:55.954679 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ca94578f-62de-4096-aef8-b5e3337b8cb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:55.958370 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ca94578f-62de-4096-aef8-b5e3337b8cb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:55.977584 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ca94578f-62de-4096-aef8-b5e3337b8cb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:55.978128 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ca94578f-62de-4096-aef8-b5e3337b8cb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:55.982311 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ca94578f-62de-4096-aef8-b5e3337b8cb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:55.983218 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ca94578f-62de-4096-aef8-b5e3337b8cb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:55.983702 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ca94578f-62de-4096-aef8-b5e3337b8cb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:55.984151 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ca94578f-62de-4096-aef8-b5e3337b8cb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:56.141715 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a3351dfc-70c0-489b-8107-5ebd2830cddf tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:56.153061 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a3351dfc-70c0-489b-8107-5ebd2830cddf tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:56.169249 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a3351dfc-70c0-489b-8107-5ebd2830cddf tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:56.170785 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a3351dfc-70c0-489b-8107-5ebd2830cddf tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1662 microversion: 2.20 time: 0.393365 Aug 24 17:51:56.171987 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 201/392] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:55 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1662 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:56.206213 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f07149fb-1ff8-46dd-b86b-056b1eb2e247 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:56.207217 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f07149fb-1ff8-46dd-b86b-056b1eb2e247 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:56.218178 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f07149fb-1ff8-46dd-b86b-056b1eb2e247 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:56.219442 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f07149fb-1ff8-46dd-b86b-056b1eb2e247 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:56.220200 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f07149fb-1ff8-46dd-b86b-056b1eb2e247 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:56.226246 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f07149fb-1ff8-46dd-b86b-056b1eb2e247 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:56.226246 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f07149fb-1ff8-46dd-b86b-056b1eb2e247 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:56.226246 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f07149fb-1ff8-46dd-b86b-056b1eb2e247 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:56.401712 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-ca94578f-62de-4096-aef8-b5e3337b8cb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:56.441124 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ca94578f-62de-4096-aef8-b5e3337b8cb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.491786 Aug 24 17:51:56.453918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 192/393] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:55 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:56.453918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-6df184b5-2c7a-45cc-8526-4a5f3501beb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9be66cc3-25d6-415b-8b26-49cf9aa63b59"}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:56.453918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-6df184b5-2c7a-45cc-8526-4a5f3501beb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:56.461595 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6df184b5-2c7a-45cc-8526-4a5f3501beb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:56.462337 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6df184b5-2c7a-45cc-8526-4a5f3501beb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:56.462884 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6df184b5-2c7a-45cc-8526-4a5f3501beb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:56.463857 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6df184b5-2c7a-45cc-8526-4a5f3501beb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:56.464437 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6df184b5-2c7a-45cc-8526-4a5f3501beb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:56.464961 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6df184b5-2c7a-45cc-8526-4a5f3501beb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:56.533447 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f07149fb-1ff8-46dd-b86b-056b1eb2e247 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:56.543712 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f07149fb-1ff8-46dd-b86b-056b1eb2e247 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1507 microversion: 2.1 time: 0.344770 Aug 24 17:51:56.547446 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 202/394] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:56 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:57.468394 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-344a7036-2cc4-4e83-b9d5-9614ed8b92e4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:57.469766 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-344a7036-2cc4-4e83-b9d5-9614ed8b92e4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:57.491227 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-344a7036-2cc4-4e83-b9d5-9614ed8b92e4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:57.498483 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-344a7036-2cc4-4e83-b9d5-9614ed8b92e4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:57.498719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-344a7036-2cc4-4e83-b9d5-9614ed8b92e4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:57.499878 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-344a7036-2cc4-4e83-b9d5-9614ed8b92e4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:57.500518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-344a7036-2cc4-4e83-b9d5-9614ed8b92e4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:57.501113 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-344a7036-2cc4-4e83-b9d5-9614ed8b92e4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:57.765159 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-344a7036-2cc4-4e83-b9d5-9614ed8b92e4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:57.776447 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-344a7036-2cc4-4e83-b9d5-9614ed8b92e4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.312574 Aug 24 17:51:57.777628 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 203/395] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:57 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:57.887664 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-6df184b5-2c7a-45cc-8526-4a5f3501beb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "POST /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.443325 Aug 24 17:51:57.889463 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 193/396] 10.222.0.76 () {62 vars in 1364 bytes} [Wed Aug 24 17:51:56 2022] POST /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/os-volume_attachments => generated 188 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:51:58.092594 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f0af4bd3-14a5-420a-b7e7-5bb6b159804e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:58.093995 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f0af4bd3-14a5-420a-b7e7-5bb6b159804e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:58.101898 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f0af4bd3-14a5-420a-b7e7-5bb6b159804e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:58.102534 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f0af4bd3-14a5-420a-b7e7-5bb6b159804e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:58.103461 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f0af4bd3-14a5-420a-b7e7-5bb6b159804e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:58.104313 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f0af4bd3-14a5-420a-b7e7-5bb6b159804e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:58.104905 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f0af4bd3-14a5-420a-b7e7-5bb6b159804e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:58.106782 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f0af4bd3-14a5-420a-b7e7-5bb6b159804e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:58.177061 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f0af4bd3-14a5-420a-b7e7-5bb6b159804e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127676) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 17:51:58.743148 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f0af4bd3-14a5-420a-b7e7-5bb6b159804e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "POST /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/action" status: 202 len: 0 microversion: 2.20 time: 0.655222 Aug 24 17:51:58.744902 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 204/397] 10.222.0.76 () {62 vars in 1319 bytes} [Wed Aug 24 17:51:58 2022] POST /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/action => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:51:58.755440 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-7f22daa1-d1f2-459a-873d-47342583ca53 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:58.757616 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-7f22daa1-d1f2-459a-873d-47342583ca53 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:58.766565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7f22daa1-d1f2-459a-873d-47342583ca53 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:58.767072 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7f22daa1-d1f2-459a-873d-47342583ca53 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:58.767731 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7f22daa1-d1f2-459a-873d-47342583ca53 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:58.768489 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7f22daa1-d1f2-459a-873d-47342583ca53 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:58.768952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7f22daa1-d1f2-459a-873d-47342583ca53 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:58.769416 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7f22daa1-d1f2-459a-873d-47342583ca53 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:58.799334 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-58e33376-b310-476b-ab93-b893ea03531b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:58.800128 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-58e33376-b310-476b-ab93-b893ea03531b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:58.806786 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58e33376-b310-476b-ab93-b893ea03531b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:58.807844 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58e33376-b310-476b-ab93-b893ea03531b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:58.809394 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58e33376-b310-476b-ab93-b893ea03531b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:58.810389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58e33376-b310-476b-ab93-b893ea03531b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:58.811057 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58e33376-b310-476b-ab93-b893ea03531b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:58.811683 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58e33376-b310-476b-ab93-b893ea03531b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:59.133973 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7f22daa1-d1f2-459a-873d-47342583ca53 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:59.166930 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-58e33376-b310-476b-ab93-b893ea03531b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:59.168969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7f22daa1-d1f2-459a-873d-47342583ca53 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:59.181653 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-58e33376-b310-476b-ab93-b893ea03531b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.386331 Aug 24 17:51:59.183125 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7f22daa1-d1f2-459a-873d-47342583ca53 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:59.185686 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-7f22daa1-d1f2-459a-873d-47342583ca53 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1748 microversion: 2.20 time: 0.435930 Aug 24 17:51:59.187264 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 194/398] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:58 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1748 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:51:59.190247 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 205/399] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:58 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:00.226581 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-4e24a4d2-3cde-416e-8772-08f2d5b4a6b3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:00.227868 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4e24a4d2-3cde-416e-8772-08f2d5b4a6b3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:00.232443 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-eee17971-ca8d-4283-af95-b0201ac62c2d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:00.233697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-eee17971-ca8d-4283-af95-b0201ac62c2d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:00.250099 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e24a4d2-3cde-416e-8772-08f2d5b4a6b3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:00.250742 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e24a4d2-3cde-416e-8772-08f2d5b4a6b3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:00.258032 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e24a4d2-3cde-416e-8772-08f2d5b4a6b3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:00.258032 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e24a4d2-3cde-416e-8772-08f2d5b4a6b3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:00.258032 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e24a4d2-3cde-416e-8772-08f2d5b4a6b3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:00.258032 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e24a4d2-3cde-416e-8772-08f2d5b4a6b3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:00.259435 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eee17971-ca8d-4283-af95-b0201ac62c2d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:00.263410 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eee17971-ca8d-4283-af95-b0201ac62c2d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:00.264418 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eee17971-ca8d-4283-af95-b0201ac62c2d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:00.266734 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eee17971-ca8d-4283-af95-b0201ac62c2d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:00.269785 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eee17971-ca8d-4283-af95-b0201ac62c2d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:00.276954 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eee17971-ca8d-4283-af95-b0201ac62c2d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:00.737942 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-4e24a4d2-3cde-416e-8772-08f2d5b4a6b3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:00.751551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-4e24a4d2-3cde-416e-8772-08f2d5b4a6b3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:00.754140 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-4e24a4d2-3cde-416e-8772-08f2d5b4a6b3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:00.761093 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-4e24a4d2-3cde-416e-8772-08f2d5b4a6b3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1748 microversion: 2.20 time: 0.533645 Aug 24 17:52:00.763432 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 206/400] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:00 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1748 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:52:00.796404 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-eee17971-ca8d-4283-af95-b0201ac62c2d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:00.809704 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-eee17971-ca8d-4283-af95-b0201ac62c2d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.590248 Aug 24 17:52:00.810399 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 195/401] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:00 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:01.789223 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5d7f861b-7a4a-4b28-96f2-2349c4cf516a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:01.789837 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5d7f861b-7a4a-4b28-96f2-2349c4cf516a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:01.798982 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5d7f861b-7a4a-4b28-96f2-2349c4cf516a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:01.799640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5d7f861b-7a4a-4b28-96f2-2349c4cf516a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:01.803188 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5d7f861b-7a4a-4b28-96f2-2349c4cf516a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:01.804151 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5d7f861b-7a4a-4b28-96f2-2349c4cf516a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:01.805621 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5d7f861b-7a4a-4b28-96f2-2349c4cf516a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:01.806357 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5d7f861b-7a4a-4b28-96f2-2349c4cf516a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:01.832706 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-aecb46d5-a6ac-4c89-9883-60faae566930 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:01.833330 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-aecb46d5-a6ac-4c89-9883-60faae566930 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:01.852397 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-aecb46d5-a6ac-4c89-9883-60faae566930 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:01.853542 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-aecb46d5-a6ac-4c89-9883-60faae566930 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:01.854851 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-aecb46d5-a6ac-4c89-9883-60faae566930 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:01.858067 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-aecb46d5-a6ac-4c89-9883-60faae566930 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:01.859028 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-aecb46d5-a6ac-4c89-9883-60faae566930 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:01.860463 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-aecb46d5-a6ac-4c89-9883-60faae566930 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:02.072600 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5d7f861b-7a4a-4b28-96f2-2349c4cf516a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:02.083062 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5d7f861b-7a4a-4b28-96f2-2349c4cf516a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:02.084998 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5d7f861b-7a4a-4b28-96f2-2349c4cf516a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:02.086087 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5d7f861b-7a4a-4b28-96f2-2349c4cf516a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1750 microversion: 2.20 time: 0.301995 Aug 24 17:52:02.087075 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 207/402] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:01 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1750 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:02.094739 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-aecb46d5-a6ac-4c89-9883-60faae566930 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:02.131140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-aecb46d5-a6ac-4c89-9883-60faae566930 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.303668 Aug 24 17:52:02.139554 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 196/403] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:01 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:03.121243 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5581a90e-13e0-456b-b72f-c25141a8e2cc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:03.122660 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5581a90e-13e0-456b-b72f-c25141a8e2cc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:03.130690 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5581a90e-13e0-456b-b72f-c25141a8e2cc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:03.131388 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5581a90e-13e0-456b-b72f-c25141a8e2cc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:03.132023 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5581a90e-13e0-456b-b72f-c25141a8e2cc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:03.132736 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5581a90e-13e0-456b-b72f-c25141a8e2cc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:03.133202 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5581a90e-13e0-456b-b72f-c25141a8e2cc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:03.133635 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5581a90e-13e0-456b-b72f-c25141a8e2cc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:03.158032 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-59c8cbb0-7442-4e00-9632-2e9fad2f6c51 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:03.159398 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-59c8cbb0-7442-4e00-9632-2e9fad2f6c51 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:03.170003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-59c8cbb0-7442-4e00-9632-2e9fad2f6c51 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:03.170936 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-59c8cbb0-7442-4e00-9632-2e9fad2f6c51 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:03.171762 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-59c8cbb0-7442-4e00-9632-2e9fad2f6c51 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:03.172725 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-59c8cbb0-7442-4e00-9632-2e9fad2f6c51 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:03.173366 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-59c8cbb0-7442-4e00-9632-2e9fad2f6c51 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:03.174387 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-59c8cbb0-7442-4e00-9632-2e9fad2f6c51 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:03.423070 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5581a90e-13e0-456b-b72f-c25141a8e2cc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:03.441780 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5581a90e-13e0-456b-b72f-c25141a8e2cc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:03.443341 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5581a90e-13e0-456b-b72f-c25141a8e2cc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:03.453190 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5581a90e-13e0-456b-b72f-c25141a8e2cc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1750 microversion: 2.20 time: 0.333778 Aug 24 17:52:03.453190 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 208/404] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:03 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1750 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:03.505322 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-59c8cbb0-7442-4e00-9632-2e9fad2f6c51 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:03.514682 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-59c8cbb0-7442-4e00-9632-2e9fad2f6c51 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.364050 Aug 24 17:52:03.515955 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 197/405] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:03 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:04.486050 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-caef03ad-7798-429d-9081-d26acb459c4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:04.486680 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-caef03ad-7798-429d-9081-d26acb459c4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:04.489321 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:04.505094 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-caef03ad-7798-429d-9081-d26acb459c4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:04.505533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-caef03ad-7798-429d-9081-d26acb459c4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:04.506228 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-caef03ad-7798-429d-9081-d26acb459c4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:04.507292 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-caef03ad-7798-429d-9081-d26acb459c4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:04.507794 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-caef03ad-7798-429d-9081-d26acb459c4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:04.508225 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-caef03ad-7798-429d-9081-d26acb459c4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:04.540596 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-561a0109-b77c-410d-bf96-7818eca18b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:04.542183 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-561a0109-b77c-410d-bf96-7818eca18b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:04.586447 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-561a0109-b77c-410d-bf96-7818eca18b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:04.588496 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-561a0109-b77c-410d-bf96-7818eca18b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:04.590517 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-561a0109-b77c-410d-bf96-7818eca18b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:04.591372 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-561a0109-b77c-410d-bf96-7818eca18b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:04.593273 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-561a0109-b77c-410d-bf96-7818eca18b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:04.593895 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-561a0109-b77c-410d-bf96-7818eca18b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:04.772817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-caef03ad-7798-429d-9081-d26acb459c4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:04.787947 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-caef03ad-7798-429d-9081-d26acb459c4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:04.792791 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-caef03ad-7798-429d-9081-d26acb459c4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:04.794887 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-caef03ad-7798-429d-9081-d26acb459c4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.315114 Aug 24 17:52:04.796578 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 209/406] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:04 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:04.903052 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-561a0109-b77c-410d-bf96-7818eca18b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:04.916539 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-561a0109-b77c-410d-bf96-7818eca18b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.383040 Aug 24 17:52:04.931740 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 198/407] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:04 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:05.828709 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-919feb74-5013-44ab-ace6-688a0b8e116f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:05.828709 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-919feb74-5013-44ab-ace6-688a0b8e116f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:05.829656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-919feb74-5013-44ab-ace6-688a0b8e116f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:05.830352 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-919feb74-5013-44ab-ace6-688a0b8e116f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:05.830829 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-919feb74-5013-44ab-ace6-688a0b8e116f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:05.831947 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-919feb74-5013-44ab-ace6-688a0b8e116f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:05.832874 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-919feb74-5013-44ab-ace6-688a0b8e116f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:05.833491 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-919feb74-5013-44ab-ace6-688a0b8e116f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:05.940963 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-19e4e6ef-e555-445b-bd06-bd5c3b1a7fbe tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:05.942256 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-19e4e6ef-e555-445b-bd06-bd5c3b1a7fbe tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:05.957251 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-19e4e6ef-e555-445b-bd06-bd5c3b1a7fbe tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:05.957948 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-19e4e6ef-e555-445b-bd06-bd5c3b1a7fbe tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:05.962776 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-19e4e6ef-e555-445b-bd06-bd5c3b1a7fbe tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:05.963625 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-19e4e6ef-e555-445b-bd06-bd5c3b1a7fbe tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:05.964115 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-19e4e6ef-e555-445b-bd06-bd5c3b1a7fbe tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:05.970314 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-19e4e6ef-e555-445b-bd06-bd5c3b1a7fbe tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:06.021674 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:06.038862 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-919feb74-5013-44ab-ace6-688a0b8e116f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:06.060625 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-919feb74-5013-44ab-ace6-688a0b8e116f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:06.075544 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-919feb74-5013-44ab-ace6-688a0b8e116f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:06.076810 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-919feb74-5013-44ab-ace6-688a0b8e116f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.260653 Aug 24 17:52:06.077421 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 210/408] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:05 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:06.210392 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-19e4e6ef-e555-445b-bd06-bd5c3b1a7fbe tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:06.219948 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-19e4e6ef-e555-445b-bd06-bd5c3b1a7fbe tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.282778 Aug 24 17:52:06.220557 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 199/409] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:05 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:07.104315 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a3dd615e-ad27-4456-bc39-f96fa000de89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:07.106415 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a3dd615e-ad27-4456-bc39-f96fa000de89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:07.115331 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a3dd615e-ad27-4456-bc39-f96fa000de89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:07.119335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a3dd615e-ad27-4456-bc39-f96fa000de89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:07.119335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a3dd615e-ad27-4456-bc39-f96fa000de89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:07.119335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a3dd615e-ad27-4456-bc39-f96fa000de89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:07.119335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a3dd615e-ad27-4456-bc39-f96fa000de89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:07.119827 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a3dd615e-ad27-4456-bc39-f96fa000de89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:07.247452 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-57d47951-4d11-436e-b18a-fa5e1c982ba3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:07.249231 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-57d47951-4d11-436e-b18a-fa5e1c982ba3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:07.259736 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-57d47951-4d11-436e-b18a-fa5e1c982ba3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:07.260552 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-57d47951-4d11-436e-b18a-fa5e1c982ba3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:07.261257 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-57d47951-4d11-436e-b18a-fa5e1c982ba3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:07.264041 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-57d47951-4d11-436e-b18a-fa5e1c982ba3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:07.264750 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-57d47951-4d11-436e-b18a-fa5e1c982ba3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:07.265335 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-57d47951-4d11-436e-b18a-fa5e1c982ba3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:07.283773 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a3dd615e-ad27-4456-bc39-f96fa000de89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:07.295791 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a3dd615e-ad27-4456-bc39-f96fa000de89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:07.297360 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a3dd615e-ad27-4456-bc39-f96fa000de89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:07.298611 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a3dd615e-ad27-4456-bc39-f96fa000de89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.199099 Aug 24 17:52:07.314661 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 211/410] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:07 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:52:07.422821 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-57d47951-4d11-436e-b18a-fa5e1c982ba3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:07.431265 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-57d47951-4d11-436e-b18a-fa5e1c982ba3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.190419 Aug 24 17:52:07.431855 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 200/411] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:07 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:08.325058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d3345a90-9660-4140-8825-cb621116a5d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:08.325758 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d3345a90-9660-4140-8825-cb621116a5d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:08.338778 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d3345a90-9660-4140-8825-cb621116a5d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:08.344213 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d3345a90-9660-4140-8825-cb621116a5d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:08.344213 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d3345a90-9660-4140-8825-cb621116a5d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:08.344213 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d3345a90-9660-4140-8825-cb621116a5d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:08.344213 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d3345a90-9660-4140-8825-cb621116a5d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:08.344569 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d3345a90-9660-4140-8825-cb621116a5d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:08.457066 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4815c732-1d70-4b12-a1f8-8c845d4713f2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:08.458525 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4815c732-1d70-4b12-a1f8-8c845d4713f2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:08.478830 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4815c732-1d70-4b12-a1f8-8c845d4713f2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:08.483875 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4815c732-1d70-4b12-a1f8-8c845d4713f2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:08.486678 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4815c732-1d70-4b12-a1f8-8c845d4713f2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:08.487681 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4815c732-1d70-4b12-a1f8-8c845d4713f2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:08.488401 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4815c732-1d70-4b12-a1f8-8c845d4713f2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:08.489489 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4815c732-1d70-4b12-a1f8-8c845d4713f2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:08.619243 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d3345a90-9660-4140-8825-cb621116a5d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:08.633431 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d3345a90-9660-4140-8825-cb621116a5d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:08.635064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d3345a90-9660-4140-8825-cb621116a5d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:08.636253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d3345a90-9660-4140-8825-cb621116a5d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.316917 Aug 24 17:52:08.636920 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 212/412] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:08 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:08.732691 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-4815c732-1d70-4b12-a1f8-8c845d4713f2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:08.748118 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-4815c732-1d70-4b12-a1f8-8c845d4713f2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.296931 Aug 24 17:52:08.749522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 201/413] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:08 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:09.671466 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-8468c19e-d7c5-47fa-af01-24f5cfde084a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:09.673638 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-8468c19e-d7c5-47fa-af01-24f5cfde084a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:09.696785 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8468c19e-d7c5-47fa-af01-24f5cfde084a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:09.696785 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8468c19e-d7c5-47fa-af01-24f5cfde084a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:09.702733 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8468c19e-d7c5-47fa-af01-24f5cfde084a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:09.705973 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8468c19e-d7c5-47fa-af01-24f5cfde084a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:09.706466 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8468c19e-d7c5-47fa-af01-24f5cfde084a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:09.706911 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8468c19e-d7c5-47fa-af01-24f5cfde084a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:09.881230 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5fdeda16-8670-430e-b1a3-3f9e07d2b392 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Action: 'create', calling method: .version_select at 0x7fce775b18b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1931889606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2hSgVy2l5Ry9wkphBWls4NtKdc/UPnY8D7oxNDGWoqXmNtQMqhzgua+zwEn1Q0RYefPUNvEfzaxwvqcoQ9hsefmAS6v+pscRNXzHib6KXcnjJvGC1k5pVUosw2JKVBcg=="}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:09.932258 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-5fdeda16-8670-430e-b1a3-3f9e07d2b392 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Getting quotas for project 54cebab3bf1f440dbaa4ef020177a4bb. Resources: {'key_pairs'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:52:09.944417 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-5fdeda16-8670-430e-b1a3-3f9e07d2b392 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Getting quotas for user f19bf0e6a8ad425cbbf804d6d7be5a0a and project 54cebab3bf1f440dbaa4ef020177a4bb. Resources: {'key_pairs'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:52:10.024782 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-8468c19e-d7c5-47fa-af01-24f5cfde084a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:10.033246 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-8468c19e-d7c5-47fa-af01-24f5cfde084a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:10.034766 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-8468c19e-d7c5-47fa-af01-24f5cfde084a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:10.043191 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-8468c19e-d7c5-47fa-af01-24f5cfde084a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.382315 Aug 24 17:52:10.043779 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 202/414] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:09 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:10.049339 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-8f96def3-417c-405e-89c3-af125d90116c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:10.049981 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-8f96def3-417c-405e-89c3-af125d90116c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:10.057001 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8f96def3-417c-405e-89c3-af125d90116c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:10.057712 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8f96def3-417c-405e-89c3-af125d90116c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:10.059050 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8f96def3-417c-405e-89c3-af125d90116c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:10.059923 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8f96def3-417c-405e-89c3-af125d90116c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:10.060667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8f96def3-417c-405e-89c3-af125d90116c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:10.061241 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8f96def3-417c-405e-89c3-af125d90116c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:10.239828 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-8f96def3-417c-405e-89c3-af125d90116c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:10.254168 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5fdeda16-8670-430e-b1a3-3f9e07d2b392 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.805714 Aug 24 17:52:10.255035 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-8f96def3-417c-405e-89c3-af125d90116c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.209894 Aug 24 17:52:10.255431 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 213/415] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 17:52:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:52:10.256446 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 203/416] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:10 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:11.069899 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-c2c5647a-143f-42c9-af77-efeaee1591e3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:11.071547 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-c2c5647a-143f-42c9-af77-efeaee1591e3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:11.080361 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c2c5647a-143f-42c9-af77-efeaee1591e3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:11.081690 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c2c5647a-143f-42c9-af77-efeaee1591e3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:11.082898 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c2c5647a-143f-42c9-af77-efeaee1591e3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:11.089652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c2c5647a-143f-42c9-af77-efeaee1591e3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:11.089652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c2c5647a-143f-42c9-af77-efeaee1591e3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:11.089652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c2c5647a-143f-42c9-af77-efeaee1591e3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:11.281303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-b259b191-7f20-4aa3-a181-c8c099319ba8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:11.282047 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-b259b191-7f20-4aa3-a181-c8c099319ba8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:11.294307 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b259b191-7f20-4aa3-a181-c8c099319ba8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:11.294307 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b259b191-7f20-4aa3-a181-c8c099319ba8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:11.295255 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b259b191-7f20-4aa3-a181-c8c099319ba8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:11.296452 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b259b191-7f20-4aa3-a181-c8c099319ba8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:11.297968 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b259b191-7f20-4aa3-a181-c8c099319ba8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:11.299108 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b259b191-7f20-4aa3-a181-c8c099319ba8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:11.330199 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c2c5647a-143f-42c9-af77-efeaee1591e3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:11.348594 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c2c5647a-143f-42c9-af77-efeaee1591e3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:11.352007 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c2c5647a-143f-42c9-af77-efeaee1591e3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:11.354255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-c2c5647a-143f-42c9-af77-efeaee1591e3 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.288820 Aug 24 17:52:11.356374 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 214/417] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:11 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:11.541110 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-b259b191-7f20-4aa3-a181-c8c099319ba8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:11.549351 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-b259b191-7f20-4aa3-a181-c8c099319ba8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.272806 Aug 24 17:52:11.553916 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 204/418] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:11 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:12.380210 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-972c7076-7f05-47c5-bf7f-068ad5777d32 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:12.380901 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-972c7076-7f05-47c5-bf7f-068ad5777d32 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:12.388252 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-972c7076-7f05-47c5-bf7f-068ad5777d32 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:12.388746 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-972c7076-7f05-47c5-bf7f-068ad5777d32 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:12.389241 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-972c7076-7f05-47c5-bf7f-068ad5777d32 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:12.390214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-972c7076-7f05-47c5-bf7f-068ad5777d32 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:12.391000 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-972c7076-7f05-47c5-bf7f-068ad5777d32 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:12.391648 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-972c7076-7f05-47c5-bf7f-068ad5777d32 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:12.570823 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-972c7076-7f05-47c5-bf7f-068ad5777d32 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:12.576598 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-b6a87968-0c19-4baf-b77a-ad7dfd6c1516 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:12.577293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-b6a87968-0c19-4baf-b77a-ad7dfd6c1516 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:12.585876 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b6a87968-0c19-4baf-b77a-ad7dfd6c1516 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:12.590760 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b6a87968-0c19-4baf-b77a-ad7dfd6c1516 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:12.592071 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b6a87968-0c19-4baf-b77a-ad7dfd6c1516 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:12.593603 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-972c7076-7f05-47c5-bf7f-068ad5777d32 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:12.595046 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b6a87968-0c19-4baf-b77a-ad7dfd6c1516 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:12.595744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b6a87968-0c19-4baf-b77a-ad7dfd6c1516 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:12.597584 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-972c7076-7f05-47c5-bf7f-068ad5777d32 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:12.598323 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b6a87968-0c19-4baf-b77a-ad7dfd6c1516 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:12.601565 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-972c7076-7f05-47c5-bf7f-068ad5777d32 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.225443 Aug 24 17:52:12.606298 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 215/419] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:12 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:12.761828 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-b6a87968-0c19-4baf-b77a-ad7dfd6c1516 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:12.770071 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-b6a87968-0c19-4baf-b77a-ad7dfd6c1516 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.202703 Aug 24 17:52:12.770776 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 205/420] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:12 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:13.631624 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-4f24b799-6550-4593-8130-52b62883a01f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:13.632282 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4f24b799-6550-4593-8130-52b62883a01f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:13.639507 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4f24b799-6550-4593-8130-52b62883a01f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:13.639996 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4f24b799-6550-4593-8130-52b62883a01f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:13.640432 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4f24b799-6550-4593-8130-52b62883a01f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:13.641372 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4f24b799-6550-4593-8130-52b62883a01f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:13.641825 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4f24b799-6550-4593-8130-52b62883a01f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:13.642287 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4f24b799-6550-4593-8130-52b62883a01f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:13.668609 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:13.795124 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-dfb0563c-e54a-4369-a63a-3cba6cf06905 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:13.796487 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-dfb0563c-e54a-4369-a63a-3cba6cf06905 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:13.807099 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dfb0563c-e54a-4369-a63a-3cba6cf06905 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:13.814277 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dfb0563c-e54a-4369-a63a-3cba6cf06905 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:13.815404 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dfb0563c-e54a-4369-a63a-3cba6cf06905 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:13.816195 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dfb0563c-e54a-4369-a63a-3cba6cf06905 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:13.816940 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dfb0563c-e54a-4369-a63a-3cba6cf06905 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:13.817606 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dfb0563c-e54a-4369-a63a-3cba6cf06905 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:13.917076 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-4f24b799-6550-4593-8130-52b62883a01f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:13.935610 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-4f24b799-6550-4593-8130-52b62883a01f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:13.938150 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-4f24b799-6550-4593-8130-52b62883a01f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:13.946488 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-4f24b799-6550-4593-8130-52b62883a01f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.311143 Aug 24 17:52:13.961042 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 216/421] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:13 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:14.140463 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-dfb0563c-e54a-4369-a63a-3cba6cf06905 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:14.154905 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-dfb0563c-e54a-4369-a63a-3cba6cf06905 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.363980 Aug 24 17:52:14.156255 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 206/422] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:13 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:14.973736 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0373fa60-af6f-40ca-99ec-39ba065c2895 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:14.974612 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0373fa60-af6f-40ca-99ec-39ba065c2895 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:14.987361 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0373fa60-af6f-40ca-99ec-39ba065c2895 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:14.987861 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0373fa60-af6f-40ca-99ec-39ba065c2895 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:14.988302 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0373fa60-af6f-40ca-99ec-39ba065c2895 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:14.989020 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0373fa60-af6f-40ca-99ec-39ba065c2895 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:14.989467 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0373fa60-af6f-40ca-99ec-39ba065c2895 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:14.998725 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0373fa60-af6f-40ca-99ec-39ba065c2895 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:15.176843 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-efcf9544-54e7-4189-b46f-7e437bfd79af tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:15.177469 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-efcf9544-54e7-4189-b46f-7e437bfd79af tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:15.185166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-efcf9544-54e7-4189-b46f-7e437bfd79af tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:15.185647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-efcf9544-54e7-4189-b46f-7e437bfd79af tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:15.186146 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-efcf9544-54e7-4189-b46f-7e437bfd79af tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:15.186827 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-efcf9544-54e7-4189-b46f-7e437bfd79af tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:15.187288 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-efcf9544-54e7-4189-b46f-7e437bfd79af tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:15.187814 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-efcf9544-54e7-4189-b46f-7e437bfd79af tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:15.356972 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0373fa60-af6f-40ca-99ec-39ba065c2895 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:15.371871 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0373fa60-af6f-40ca-99ec-39ba065c2895 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:15.376727 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0373fa60-af6f-40ca-99ec-39ba065c2895 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:15.380102 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0373fa60-af6f-40ca-99ec-39ba065c2895 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.410295 Aug 24 17:52:15.393736 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 217/423] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:14 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:15.501845 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-efcf9544-54e7-4189-b46f-7e437bfd79af tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:15.509995 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-efcf9544-54e7-4189-b46f-7e437bfd79af tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.336986 Aug 24 17:52:15.512292 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 207/424] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:15 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:16.338450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-57c09970-689b-42a6-8b67-a1676dca393c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3c95cdc-2d5c-4649-96bc-0913c0fa9a82", "device": "/dev/sdb"}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:16.346151 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-57c09970-689b-42a6-8b67-a1676dca393c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:16.352777 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57c09970-689b-42a6-8b67-a1676dca393c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:16.353684 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57c09970-689b-42a6-8b67-a1676dca393c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:16.354330 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57c09970-689b-42a6-8b67-a1676dca393c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:16.355634 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57c09970-689b-42a6-8b67-a1676dca393c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:16.356453 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57c09970-689b-42a6-8b67-a1676dca393c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:16.356901 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57c09970-689b-42a6-8b67-a1676dca393c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:16.421483 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-321f2ea8-c438-4698-b1c7-8f51bb12b482 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:16.422147 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-321f2ea8-c438-4698-b1c7-8f51bb12b482 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:16.430271 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-321f2ea8-c438-4698-b1c7-8f51bb12b482 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:16.431021 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-321f2ea8-c438-4698-b1c7-8f51bb12b482 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:16.431746 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-321f2ea8-c438-4698-b1c7-8f51bb12b482 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:16.432776 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-321f2ea8-c438-4698-b1c7-8f51bb12b482 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:16.433939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-321f2ea8-c438-4698-b1c7-8f51bb12b482 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:16.434671 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-321f2ea8-c438-4698-b1c7-8f51bb12b482 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:16.661691 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-321f2ea8-c438-4698-b1c7-8f51bb12b482 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:16.677399 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-321f2ea8-c438-4698-b1c7-8f51bb12b482 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:16.677399 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-321f2ea8-c438-4698-b1c7-8f51bb12b482 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:16.678941 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-321f2ea8-c438-4698-b1c7-8f51bb12b482 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.263134 Aug 24 17:52:16.679596 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 208/425] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:16 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:52:16.685312 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-56e4aefe-96be-4413-b5b0-bcaca2a72ad4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:16.686273 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-56e4aefe-96be-4413-b5b0-bcaca2a72ad4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:16.693080 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-56e4aefe-96be-4413-b5b0-bcaca2a72ad4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:16.694057 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-56e4aefe-96be-4413-b5b0-bcaca2a72ad4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:16.694661 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-56e4aefe-96be-4413-b5b0-bcaca2a72ad4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:16.696227 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-56e4aefe-96be-4413-b5b0-bcaca2a72ad4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:16.697262 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-56e4aefe-96be-4413-b5b0-bcaca2a72ad4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:16.697700 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-56e4aefe-96be-4413-b5b0-bcaca2a72ad4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:16.889900 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-56e4aefe-96be-4413-b5b0-bcaca2a72ad4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:16.900026 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-56e4aefe-96be-4413-b5b0-bcaca2a72ad4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.219065 Aug 24 17:52:16.906445 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 209/426] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:16 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:17.710105 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-531d80a5-a2b6-4364-bb92-d6b47afa82e4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:17.711889 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-531d80a5-a2b6-4364-bb92-d6b47afa82e4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:17.719247 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-531d80a5-a2b6-4364-bb92-d6b47afa82e4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:17.719729 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-531d80a5-a2b6-4364-bb92-d6b47afa82e4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:17.720630 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-531d80a5-a2b6-4364-bb92-d6b47afa82e4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:17.720837 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-531d80a5-a2b6-4364-bb92-d6b47afa82e4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:17.721290 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-531d80a5-a2b6-4364-bb92-d6b47afa82e4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:17.721709 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-531d80a5-a2b6-4364-bb92-d6b47afa82e4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:17.951501 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-531d80a5-a2b6-4364-bb92-d6b47afa82e4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:17.964336 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-531d80a5-a2b6-4364-bb92-d6b47afa82e4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:17.966508 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-531d80a5-a2b6-4364-bb92-d6b47afa82e4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:17.968341 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-531d80a5-a2b6-4364-bb92-d6b47afa82e4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.267246 Aug 24 17:52:17.969091 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 210/427] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:17 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:52:17.982296 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-7ee9af81-359b-4f45-b9db-65108c1fb918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:17.983347 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-7ee9af81-359b-4f45-b9db-65108c1fb918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:17.990261 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7ee9af81-359b-4f45-b9db-65108c1fb918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:17.990646 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7ee9af81-359b-4f45-b9db-65108c1fb918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:17.991114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7ee9af81-359b-4f45-b9db-65108c1fb918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:17.991837 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7ee9af81-359b-4f45-b9db-65108c1fb918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:17.992355 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7ee9af81-359b-4f45-b9db-65108c1fb918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:17.992809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7ee9af81-359b-4f45-b9db-65108c1fb918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:18.144351 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7ee9af81-359b-4f45-b9db-65108c1fb918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:18.153791 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-7ee9af81-359b-4f45-b9db-65108c1fb918 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.178890 Aug 24 17:52:18.154399 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 211/428] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:17 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:18.998448 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-70947d4d-e1c0-4bbb-b797-0acba937934b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:18.999168 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-70947d4d-e1c0-4bbb-b797-0acba937934b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:19.006370 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-70947d4d-e1c0-4bbb-b797-0acba937934b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:19.006860 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-70947d4d-e1c0-4bbb-b797-0acba937934b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:19.007286 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-70947d4d-e1c0-4bbb-b797-0acba937934b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:19.008220 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-70947d4d-e1c0-4bbb-b797-0acba937934b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:19.008734 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-70947d4d-e1c0-4bbb-b797-0acba937934b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:19.009428 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-70947d4d-e1c0-4bbb-b797-0acba937934b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:19.202496 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-70947d4d-e1c0-4bbb-b797-0acba937934b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:19.213345 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-70947d4d-e1c0-4bbb-b797-0acba937934b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:19.215163 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-70947d4d-e1c0-4bbb-b797-0acba937934b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:19.216373 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-70947d4d-e1c0-4bbb-b797-0acba937934b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.226225 Aug 24 17:52:19.217059 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 212/429] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:18 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:52:19.238093 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-8dc7d57b-1de3-437e-81a7-240064015b65 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:19.242042 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-8dc7d57b-1de3-437e-81a7-240064015b65 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:19.246975 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8dc7d57b-1de3-437e-81a7-240064015b65 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:19.247575 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8dc7d57b-1de3-437e-81a7-240064015b65 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:19.248071 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8dc7d57b-1de3-437e-81a7-240064015b65 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:19.248900 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8dc7d57b-1de3-437e-81a7-240064015b65 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:19.249494 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8dc7d57b-1de3-437e-81a7-240064015b65 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:19.250004 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8dc7d57b-1de3-437e-81a7-240064015b65 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:19.433693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-8dc7d57b-1de3-437e-81a7-240064015b65 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:19.448040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-8dc7d57b-1de3-437e-81a7-240064015b65 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.224763 Aug 24 17:52:19.449588 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 213/430] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:19 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:19.968492 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=4 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:20.244156 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-5e9ab1bc-95d8-44e0-bc7e-ba04c3986cc7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:20.245531 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-5e9ab1bc-95d8-44e0-bc7e-ba04c3986cc7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:20.252461 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5e9ab1bc-95d8-44e0-bc7e-ba04c3986cc7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:20.252940 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5e9ab1bc-95d8-44e0-bc7e-ba04c3986cc7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:20.253563 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5e9ab1bc-95d8-44e0-bc7e-ba04c3986cc7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:20.254442 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5e9ab1bc-95d8-44e0-bc7e-ba04c3986cc7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:20.254905 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5e9ab1bc-95d8-44e0-bc7e-ba04c3986cc7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:20.255349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5e9ab1bc-95d8-44e0-bc7e-ba04c3986cc7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:20.415156 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5e9ab1bc-95d8-44e0-bc7e-ba04c3986cc7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:20.424588 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5e9ab1bc-95d8-44e0-bc7e-ba04c3986cc7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:20.426243 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5e9ab1bc-95d8-44e0-bc7e-ba04c3986cc7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:20.427555 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-5e9ab1bc-95d8-44e0-bc7e-ba04c3986cc7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.187381 Aug 24 17:52:20.428164 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 214/431] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:20 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:52:20.475946 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-11dcf3df-1f51-4dc1-8878-d3f6bcfa9c94 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:20.476596 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-11dcf3df-1f51-4dc1-8878-d3f6bcfa9c94 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:20.483254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-11dcf3df-1f51-4dc1-8878-d3f6bcfa9c94 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:20.483812 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-11dcf3df-1f51-4dc1-8878-d3f6bcfa9c94 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:20.484311 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-11dcf3df-1f51-4dc1-8878-d3f6bcfa9c94 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:20.484969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-11dcf3df-1f51-4dc1-8878-d3f6bcfa9c94 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:20.485427 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-11dcf3df-1f51-4dc1-8878-d3f6bcfa9c94 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:20.485899 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-11dcf3df-1f51-4dc1-8878-d3f6bcfa9c94 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:20.637721 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-11dcf3df-1f51-4dc1-8878-d3f6bcfa9c94 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:20.649251 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-11dcf3df-1f51-4dc1-8878-d3f6bcfa9c94 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.177203 Aug 24 17:52:20.651072 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 215/432] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:20 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:20.887859 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1244253278", "imageRef": "2d76d745-abc6-4a7b-b8d7-46566b66934b", "flavorRef": "452", "networks": [{"uuid": "1fcff867-0bc4-4478-bdf7-0cc16094d8ae"}]}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:20.956488 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.network.neutron [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] validate_networks() for [('1fcff867-0bc4-4478-bdf7-0cc16094d8ae', None, None, None, None, None)] {{(pid=127677) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:52:21.366176 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Flavor limits 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:52:21.366854 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Image limits 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:52:21.367101 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Flavor pref 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:52:21.367512 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Image pref 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:52:21.367925 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:52:21.377484 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:21.378001 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:21.378443 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:21.379239 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:21.379722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:21.380184 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:21.387386 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=100 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:21.399742 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Getting quotas for project 6e895dd83dbf4458b7d6efaace0d209a. Resources: {'instances', 'ram', 'cores'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:52:21.406198 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Getting quotas for user f08b2eba50904dda89fb743c9cf28958 and project 6e895dd83dbf4458b7d6efaace0d209a. Resources: {'instances', 'ram', 'cores'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:52:21.419939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Going to run 1 instances... {{(pid=127677) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:52:21.422430 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d76d745-abc6-4a7b-b8d7-46566b66934b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:52:21.609209 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [4d4ba482-221d-417e-af1d-ea82b39f4782] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 17:52:22.575632 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-57c09970-689b-42a6-8b67-a1676dca393c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "POST /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.241251 Aug 24 17:52:22.576270 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 218/433] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 17:52:16 2022] POST /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd/os-volume_attachments => generated 194 bytes in 6243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:52:22.581395 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-89373de1-9fd9-4e31-8a84-cbcb5c5e0949 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:22.582273 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-89373de1-9fd9-4e31-8a84-cbcb5c5e0949 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:22.588619 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-89373de1-9fd9-4e31-8a84-cbcb5c5e0949 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:22.589719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-89373de1-9fd9-4e31-8a84-cbcb5c5e0949 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:22.590202 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-89373de1-9fd9-4e31-8a84-cbcb5c5e0949 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:22.590915 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-89373de1-9fd9-4e31-8a84-cbcb5c5e0949 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:22.591373 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-89373de1-9fd9-4e31-8a84-cbcb5c5e0949 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:22.592038 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-89373de1-9fd9-4e31-8a84-cbcb5c5e0949 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:22.617182 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO oslo.messaging._drivers.impl_rabbit [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [4d4ba482-221d-417e-af1d-ea82b39f4782] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 55318. Aug 24 17:52:22.632742 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-4eb1befd-244b-44ff-984b-bb3987af0353 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.749392 Aug 24 17:52:22.641746 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 216/434] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 17:52:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:52:22.647464 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-71cf3bcd-d0fd-4015-8b1c-2d7170d7b961 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:22.649092 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-71cf3bcd-d0fd-4015-8b1c-2d7170d7b961 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:22.658233 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-71cf3bcd-d0fd-4015-8b1c-2d7170d7b961 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:22.659011 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-71cf3bcd-d0fd-4015-8b1c-2d7170d7b961 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:22.659621 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-71cf3bcd-d0fd-4015-8b1c-2d7170d7b961 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:22.660612 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-71cf3bcd-d0fd-4015-8b1c-2d7170d7b961 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:22.661241 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-71cf3bcd-d0fd-4015-8b1c-2d7170d7b961 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:22.661930 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-71cf3bcd-d0fd-4015-8b1c-2d7170d7b961 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:22.881000 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-89373de1-9fd9-4e31-8a84-cbcb5c5e0949 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:22.892494 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-89373de1-9fd9-4e31-8a84-cbcb5c5e0949 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:22.893990 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-89373de1-9fd9-4e31-8a84-cbcb5c5e0949 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:22.895633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-89373de1-9fd9-4e31-8a84-cbcb5c5e0949 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.318168 Aug 24 17:52:22.896731 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 219/435] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:22 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:22.902656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e834227b-8d51-4947-aca3-fae881e1fd1f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:22.903545 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e834227b-8d51-4947-aca3-fae881e1fd1f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:22.916572 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-71cf3bcd-d0fd-4015-8b1c-2d7170d7b961 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:22.929416 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-71cf3bcd-d0fd-4015-8b1c-2d7170d7b961 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.286336 Aug 24 17:52:22.930193 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 217/436] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:22 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:22.965018 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e834227b-8d51-4947-aca3-fae881e1fd1f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:22.972018 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e834227b-8d51-4947-aca3-fae881e1fd1f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1214 microversion: 2.1 time: 0.074007 Aug 24 17:52:22.972584 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 220/437] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:22 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:23.927695 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-2981aa11-564f-4308-8820-38571c13af1d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:23.928837 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-2981aa11-564f-4308-8820-38571c13af1d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:23.937102 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2981aa11-564f-4308-8820-38571c13af1d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:23.937591 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2981aa11-564f-4308-8820-38571c13af1d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:23.938109 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2981aa11-564f-4308-8820-38571c13af1d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:23.938823 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2981aa11-564f-4308-8820-38571c13af1d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:23.939472 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2981aa11-564f-4308-8820-38571c13af1d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:23.939905 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2981aa11-564f-4308-8820-38571c13af1d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:23.956691 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5b8751b2-c793-4799-9a66-51cf3653a3d3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:23.958432 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5b8751b2-c793-4799-9a66-51cf3653a3d3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:23.968700 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b8751b2-c793-4799-9a66-51cf3653a3d3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:23.974642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b8751b2-c793-4799-9a66-51cf3653a3d3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:23.974642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b8751b2-c793-4799-9a66-51cf3653a3d3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:23.974642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b8751b2-c793-4799-9a66-51cf3653a3d3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:23.974642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b8751b2-c793-4799-9a66-51cf3653a3d3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:23.975590 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b8751b2-c793-4799-9a66-51cf3653a3d3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:24.182039 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-2981aa11-564f-4308-8820-38571c13af1d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:24.186761 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5b8751b2-c793-4799-9a66-51cf3653a3d3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:24.191153 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-2981aa11-564f-4308-8820-38571c13af1d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:24.192660 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-2981aa11-564f-4308-8820-38571c13af1d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:24.193831 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-2981aa11-564f-4308-8820-38571c13af1d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.274476 Aug 24 17:52:24.194412 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 218/438] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:23 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:24.194532 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5b8751b2-c793-4799-9a66-51cf3653a3d3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.244403 Aug 24 17:52:24.195253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 221/439] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:23 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:24.199752 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-094ada48-f944-4a38-921a-c786b069121e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:24.200369 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-094ada48-f944-4a38-921a-c786b069121e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:24.206892 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-094ada48-f944-4a38-921a-c786b069121e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:24.207325 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-094ada48-f944-4a38-921a-c786b069121e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:24.207929 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-094ada48-f944-4a38-921a-c786b069121e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:24.208816 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-094ada48-f944-4a38-921a-c786b069121e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:24.209283 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-094ada48-f944-4a38-921a-c786b069121e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:24.209714 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-094ada48-f944-4a38-921a-c786b069121e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:24.272864 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-094ada48-f944-4a38-921a-c786b069121e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:24.282327 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-094ada48-f944-4a38-921a-c786b069121e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1218 microversion: 2.1 time: 0.086578 Aug 24 17:52:24.282966 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 219/440] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:24 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:25.216530 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7e8ddb04-621f-495f-818c-678222771734 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:25.217178 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7e8ddb04-621f-495f-818c-678222771734 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:25.217663 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d9e93cc1-72fe-4c7f-8830-96988659e338 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:25.218439 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d9e93cc1-72fe-4c7f-8830-96988659e338 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:25.224223 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7e8ddb04-621f-495f-818c-678222771734 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:25.224754 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7e8ddb04-621f-495f-818c-678222771734 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:25.225279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7e8ddb04-621f-495f-818c-678222771734 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:25.226140 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7e8ddb04-621f-495f-818c-678222771734 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:25.226543 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d9e93cc1-72fe-4c7f-8830-96988659e338 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:25.226683 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7e8ddb04-621f-495f-818c-678222771734 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:25.226998 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7e8ddb04-621f-495f-818c-678222771734 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:25.227129 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d9e93cc1-72fe-4c7f-8830-96988659e338 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:25.227480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d9e93cc1-72fe-4c7f-8830-96988659e338 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:25.228177 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d9e93cc1-72fe-4c7f-8830-96988659e338 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:25.228629 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d9e93cc1-72fe-4c7f-8830-96988659e338 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:25.229084 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d9e93cc1-72fe-4c7f-8830-96988659e338 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:25.444877 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d9e93cc1-72fe-4c7f-8830-96988659e338 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:25.473754 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7e8ddb04-621f-495f-818c-678222771734 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:25.473971 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d9e93cc1-72fe-4c7f-8830-96988659e338 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:25.473971 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d9e93cc1-72fe-4c7f-8830-96988659e338 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:25.473971 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d9e93cc1-72fe-4c7f-8830-96988659e338 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.244023 Aug 24 17:52:25.474236 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 220/441] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:25 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:25.474315 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7e8ddb04-621f-495f-818c-678222771734 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.247109 Aug 24 17:52:25.474315 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 222/442] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:25 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:25.474464 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4ca009d2-5899-4870-bb90-e40313122d3d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:25.474464 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4ca009d2-5899-4870-bb90-e40313122d3d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:25.474464 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:25.474464 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4ca009d2-5899-4870-bb90-e40313122d3d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:25.474464 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4ca009d2-5899-4870-bb90-e40313122d3d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:25.474797 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4ca009d2-5899-4870-bb90-e40313122d3d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:25.474797 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4ca009d2-5899-4870-bb90-e40313122d3d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:25.474797 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4ca009d2-5899-4870-bb90-e40313122d3d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:25.474797 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4ca009d2-5899-4870-bb90-e40313122d3d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:25.551453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-4ca009d2-5899-4870-bb90-e40313122d3d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:25.565094 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-4ca009d2-5899-4870-bb90-e40313122d3d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1210 microversion: 2.1 time: 0.106406 Aug 24 17:52:25.565793 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 221/443] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:25 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1210 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:26.484740 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f0417e25-941b-4335-955c-d9d9083db350 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:26.485433 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d27416bc-969f-4967-8f71-2a76e44f88b6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:26.486012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d27416bc-969f-4967-8f71-2a76e44f88b6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:26.486156 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-f0417e25-941b-4335-955c-d9d9083db350 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:26.497212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d27416bc-969f-4967-8f71-2a76e44f88b6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:26.497939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f0417e25-941b-4335-955c-d9d9083db350 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:26.498076 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d27416bc-969f-4967-8f71-2a76e44f88b6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:26.498734 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d27416bc-969f-4967-8f71-2a76e44f88b6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:26.498856 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f0417e25-941b-4335-955c-d9d9083db350 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:26.499696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f0417e25-941b-4335-955c-d9d9083db350 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:26.499908 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d27416bc-969f-4967-8f71-2a76e44f88b6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:26.500683 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d27416bc-969f-4967-8f71-2a76e44f88b6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:26.501023 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f0417e25-941b-4335-955c-d9d9083db350 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:26.501406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d27416bc-969f-4967-8f71-2a76e44f88b6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:26.501783 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f0417e25-941b-4335-955c-d9d9083db350 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:26.502508 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f0417e25-941b-4335-955c-d9d9083db350 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:26.741719 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f0417e25-941b-4335-955c-d9d9083db350 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:26.745765 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d27416bc-969f-4967-8f71-2a76e44f88b6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:26.751882 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-f0417e25-941b-4335-955c-d9d9083db350 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1501 microversion: 2.1 time: 0.273770 Aug 24 17:52:26.755281 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 222/444] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:26 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1501 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:26.755450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d27416bc-969f-4967-8f71-2a76e44f88b6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:26.756942 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d27416bc-969f-4967-8f71-2a76e44f88b6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:26.757344 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-cf4e8725-b34c-4b18-b83b-39f3ffacdada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:26.757978 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-cf4e8725-b34c-4b18-b83b-39f3ffacdada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:26.758339 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d27416bc-969f-4967-8f71-2a76e44f88b6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.280498 Aug 24 17:52:26.758890 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 223/445] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:26 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:26.773436 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0d9db825-7fc2-4457-a479-d788b4bba96d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dac98090-c0e0-40f0-b35e-87baf6944c47"}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:26.773677 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cf4e8725-b34c-4b18-b83b-39f3ffacdada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:26.774127 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cf4e8725-b34c-4b18-b83b-39f3ffacdada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:26.774631 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cf4e8725-b34c-4b18-b83b-39f3ffacdada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:26.775711 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cf4e8725-b34c-4b18-b83b-39f3ffacdada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:26.776250 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cf4e8725-b34c-4b18-b83b-39f3ffacdada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:26.776756 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0d9db825-7fc2-4457-a479-d788b4bba96d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:26.777122 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cf4e8725-b34c-4b18-b83b-39f3ffacdada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:26.783615 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0d9db825-7fc2-4457-a479-d788b4bba96d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:26.784106 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0d9db825-7fc2-4457-a479-d788b4bba96d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:26.784548 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0d9db825-7fc2-4457-a479-d788b4bba96d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:26.785246 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0d9db825-7fc2-4457-a479-d788b4bba96d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:26.785839 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0d9db825-7fc2-4457-a479-d788b4bba96d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:26.789691 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0d9db825-7fc2-4457-a479-d788b4bba96d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:26.813165 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-0d9db825-7fc2-4457-a479-d788b4bba96d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] HTTP exception thrown: Cannot 'attach_volume' instance 4ec18342-3f45-401f-ba1a-768a427a5fa2 while it is in vm_state rescued Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0d9db825-7fc2-4457-a479-d788b4bba96d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Request method failure captured: Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: POST /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2/os-volume_attachments HTTP/1.1 Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 74 Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmT-a9KYb466OD5Drv3Xz81qZyGQfXkbOB6dEp6k723KOUCx26OY7I-Uf1faS7dYmQ0QJhOLKeYvP_LQ2isazwrorVarlgJCG3lZ3XKvf8uWsndZrl9kdWhNBejxIoqjEkYfxmZxCfSO2IVsERdDLdkIV3PCifqVzvgcWT1JLc6EnfM Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 151e9d2b290047e8acd9468c721b9dd3 Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1512152156 Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:52:26.815203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:52:26.817663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/151e9d2b290047e8acd9468c721b9dd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/151e9d2b290047e8acd9468c721b9dd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_151e9d2b290047e8acd9468c721b9dd3", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/151e9d2b290047e8acd9468c721b9dd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:52:26.817663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1512152156 Aug 24 17:52:26.817663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 151e9d2b290047e8acd9468c721b9dd3 Aug 24 17:52:26.817663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1512152156 Aug 24 17:52:26.817663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-ServerRescueNegativeTestJSON-1512152156-project Aug 24 17:52:26.817663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:52:26.817663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:52:26.817663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 63ff0ea67ee64e14aafc5c51cad9684f Aug 24 17:52:26.817663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1512152156-project Aug 24 17:52:26.817663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Aug 24 17:52:26.817663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {"volumeAttachment": {"volumeId": "dac98090-c0e0-40f0-b35e-87baf6944c47"}} Aug 24 17:52:26.817663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:52:26.819244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Cannot 'attach_volume' instance 4ec18342-3f45-401f-ba1a-768a427a5fa2 while it is in vm_state rescued Aug 24 17:52:26.819244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'server_id': '4ec18342-3f45-401f-ba1a-768a427a5fa2', 'body': {'volumeAttachment': {'volumeId': 'dac98090-c0e0-40f0-b35e-87baf6944c47'}}} Aug 24 17:52:26.819244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:52:26.819244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:26.819244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 17:52:26.819244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 17:52:26.819244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 17:52:26.819244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 17:52:26.819244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 17:52:26.819244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 17:52:26.819244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4ec18342-3f45-401f-ba1a-768a427a5fa2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 17:52:26.819244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:52:26.819244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:52:26.819244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:52:26.819244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:26.819244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:52:26.819244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:52:26.819244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:52:26.819244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:52:26.821585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:52:26.821585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:52:26.821585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:52:26.821585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:52:26.821585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:52:26.821585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:52:26.821585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:52:26.821585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:52:26.821585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 17:52:26.821585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 17:52:26.821585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 17:52:26.821585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 17:52:26.821585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4ec18342-3f45-401f-ba1a-768a427a5fa2 while it is in vm_state rescued Aug 24 17:52:26.821585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:52:26.821585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:52:26.821585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:52:26.821585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:26.821585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:52:26.821585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:52:26.825439 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:52:26.825439 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:52:26.825439 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4ec18342-3f45-401f-ba1a-768a427a5fa2 while it is in vm_state rescued Aug 24 17:52:26.825439 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:52:26.825439 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0d9db825-7fc2-4457-a479-d788b4bba96d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Returning 409 to user: Cannot 'attach_volume' instance 4ec18342-3f45-401f-ba1a-768a427a5fa2 while it is in vm_state rescued {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:52:26.825439 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0d9db825-7fc2-4457-a479-d788b4bba96d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "POST /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047462 Aug 24 17:52:26.825439 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 224/446] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 17:52:26 2022] POST /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 17:52:26.826378 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-890253f3-3e80-4ee9-9714-e789b47ec1f8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:26.826546 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-890253f3-3e80-4ee9-9714-e789b47ec1f8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:26.833995 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-890253f3-3e80-4ee9-9714-e789b47ec1f8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:26.834487 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-890253f3-3e80-4ee9-9714-e789b47ec1f8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:26.834923 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-890253f3-3e80-4ee9-9714-e789b47ec1f8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:26.835626 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-890253f3-3e80-4ee9-9714-e789b47ec1f8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:26.836097 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-890253f3-3e80-4ee9-9714-e789b47ec1f8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:26.836499 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-890253f3-3e80-4ee9-9714-e789b47ec1f8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:26.854937 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-cf4e8725-b34c-4b18-b83b-39f3ffacdada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:26.863643 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-cf4e8725-b34c-4b18-b83b-39f3ffacdada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1210 microversion: 2.1 time: 0.109849 Aug 24 17:52:26.869629 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 223/447] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:26 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1210 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:27.066669 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-890253f3-3e80-4ee9-9714-e789b47ec1f8 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "POST /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2/action" status: 202 len: 0 microversion: 2.1 time: 0.244636 Aug 24 17:52:27.067962 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 225/448] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 17:52:26 2022] POST /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:52:27.076192 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4c284a2f-135d-4464-b30b-271442c8387e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:27.076818 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4c284a2f-135d-4464-b30b-271442c8387e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:27.083441 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4c284a2f-135d-4464-b30b-271442c8387e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:27.084007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4c284a2f-135d-4464-b30b-271442c8387e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:27.084458 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4c284a2f-135d-4464-b30b-271442c8387e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:27.085176 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4c284a2f-135d-4464-b30b-271442c8387e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:27.085638 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4c284a2f-135d-4464-b30b-271442c8387e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:27.086111 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4c284a2f-135d-4464-b30b-271442c8387e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:27.239078 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-4c284a2f-135d-4464-b30b-271442c8387e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:27.247006 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-4c284a2f-135d-4464-b30b-271442c8387e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1509 microversion: 2.1 time: 0.174886 Aug 24 17:52:27.247502 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 224/449] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:27 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:27.785087 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-67a6406b-289c-4fd8-8301-37af0fb85a06 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:27.786043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-67a6406b-289c-4fd8-8301-37af0fb85a06 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:27.792947 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-67a6406b-289c-4fd8-8301-37af0fb85a06 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:27.798732 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-67a6406b-289c-4fd8-8301-37af0fb85a06 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:27.798732 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-67a6406b-289c-4fd8-8301-37af0fb85a06 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:27.798732 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-67a6406b-289c-4fd8-8301-37af0fb85a06 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:27.798732 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-67a6406b-289c-4fd8-8301-37af0fb85a06 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:27.799146 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-67a6406b-289c-4fd8-8301-37af0fb85a06 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:27.884913 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-241ea77a-a4bd-4a33-9804-e85229f0c72d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:27.886217 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-241ea77a-a4bd-4a33-9804-e85229f0c72d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:27.893431 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-241ea77a-a4bd-4a33-9804-e85229f0c72d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:27.893960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-241ea77a-a4bd-4a33-9804-e85229f0c72d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:27.894455 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-241ea77a-a4bd-4a33-9804-e85229f0c72d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:27.895159 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-241ea77a-a4bd-4a33-9804-e85229f0c72d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:27.895615 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-241ea77a-a4bd-4a33-9804-e85229f0c72d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:27.896043 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-241ea77a-a4bd-4a33-9804-e85229f0c72d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:27.954986 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-67a6406b-289c-4fd8-8301-37af0fb85a06 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:27.964909 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-67a6406b-289c-4fd8-8301-37af0fb85a06 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:27.966504 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-67a6406b-289c-4fd8-8301-37af0fb85a06 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:27.967753 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-67a6406b-289c-4fd8-8301-37af0fb85a06 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.187758 Aug 24 17:52:27.968599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 226/450] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:27 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:27.973023 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-241ea77a-a4bd-4a33-9804-e85229f0c72d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:27.983180 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-241ea77a-a4bd-4a33-9804-e85229f0c72d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1266 microversion: 2.1 time: 0.102361 Aug 24 17:52:27.983764 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 225/451] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:27 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:28.267601 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-eca7c355-d474-4d90-ab79-8ad20edd5922 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:28.268218 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-eca7c355-d474-4d90-ab79-8ad20edd5922 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:28.274350 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-eca7c355-d474-4d90-ab79-8ad20edd5922 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:28.275092 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-eca7c355-d474-4d90-ab79-8ad20edd5922 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:28.275534 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-eca7c355-d474-4d90-ab79-8ad20edd5922 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:28.276838 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-eca7c355-d474-4d90-ab79-8ad20edd5922 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:28.277292 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-eca7c355-d474-4d90-ab79-8ad20edd5922 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:28.277730 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-eca7c355-d474-4d90-ab79-8ad20edd5922 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:28.410111 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-eca7c355-d474-4d90-ab79-8ad20edd5922 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:28.418576 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-eca7c355-d474-4d90-ab79-8ad20edd5922 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1509 microversion: 2.1 time: 0.154765 Aug 24 17:52:28.419143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 227/452] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:28 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:28.991464 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-b1d2506f-835f-4b31-9ff3-75bc7d3d1f07 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:28.992083 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-b1d2506f-835f-4b31-9ff3-75bc7d3d1f07 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:29.004289 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b1d2506f-835f-4b31-9ff3-75bc7d3d1f07 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:29.005264 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-91502cfd-6d52-43be-b8a0-15e090ff2ada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:29.005770 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b1d2506f-835f-4b31-9ff3-75bc7d3d1f07 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:29.005770 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b1d2506f-835f-4b31-9ff3-75bc7d3d1f07 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:29.006597 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b1d2506f-835f-4b31-9ff3-75bc7d3d1f07 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:29.007356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b1d2506f-835f-4b31-9ff3-75bc7d3d1f07 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:29.007766 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-91502cfd-6d52-43be-b8a0-15e090ff2ada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:29.008220 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b1d2506f-835f-4b31-9ff3-75bc7d3d1f07 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:29.018192 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-91502cfd-6d52-43be-b8a0-15e090ff2ada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:29.018846 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-91502cfd-6d52-43be-b8a0-15e090ff2ada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:29.019554 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-91502cfd-6d52-43be-b8a0-15e090ff2ada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:29.020492 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-91502cfd-6d52-43be-b8a0-15e090ff2ada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:29.021191 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-91502cfd-6d52-43be-b8a0-15e090ff2ada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:29.021873 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-91502cfd-6d52-43be-b8a0-15e090ff2ada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:29.169723 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-91502cfd-6d52-43be-b8a0-15e090ff2ada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:29.192540 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-91502cfd-6d52-43be-b8a0-15e090ff2ada tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1284 microversion: 2.1 time: 0.190911 Aug 24 17:52:29.241683 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 228/453] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:29 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:29.330958 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-b1d2506f-835f-4b31-9ff3-75bc7d3d1f07 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:29.340552 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-b1d2506f-835f-4b31-9ff3-75bc7d3d1f07 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:29.358001 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-b1d2506f-835f-4b31-9ff3-75bc7d3d1f07 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:29.358001 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-b1d2506f-835f-4b31-9ff3-75bc7d3d1f07 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.355822 Aug 24 17:52:29.358001 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 226/454] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:28 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:52:29.440082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-fce3f6af-ac3e-4388-9e06-016d7ce6dad5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:29.440699 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-fce3f6af-ac3e-4388-9e06-016d7ce6dad5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:29.447319 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fce3f6af-ac3e-4388-9e06-016d7ce6dad5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:29.448618 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fce3f6af-ac3e-4388-9e06-016d7ce6dad5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:29.449162 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fce3f6af-ac3e-4388-9e06-016d7ce6dad5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:29.449987 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fce3f6af-ac3e-4388-9e06-016d7ce6dad5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:29.450541 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fce3f6af-ac3e-4388-9e06-016d7ce6dad5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:29.451045 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fce3f6af-ac3e-4388-9e06-016d7ce6dad5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:29.667969 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-fce3f6af-ac3e-4388-9e06-016d7ce6dad5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:29.676509 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-fce3f6af-ac3e-4388-9e06-016d7ce6dad5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1509 microversion: 2.1 time: 0.240189 Aug 24 17:52:29.681628 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 229/455] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:29 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1509 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:30.263659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-90b42446-2421-44c9-a949-9485232af85d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:30.264274 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-90b42446-2421-44c9-a949-9485232af85d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:30.270702 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90b42446-2421-44c9-a949-9485232af85d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:30.271200 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90b42446-2421-44c9-a949-9485232af85d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:30.271638 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90b42446-2421-44c9-a949-9485232af85d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:30.272342 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90b42446-2421-44c9-a949-9485232af85d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:30.272802 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90b42446-2421-44c9-a949-9485232af85d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:30.273231 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90b42446-2421-44c9-a949-9485232af85d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:30.368501 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-88838518-6d2c-4622-9563-d5f2ae259254 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:30.369125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-88838518-6d2c-4622-9563-d5f2ae259254 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:30.376313 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-88838518-6d2c-4622-9563-d5f2ae259254 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:30.376800 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-88838518-6d2c-4622-9563-d5f2ae259254 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:30.377240 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-88838518-6d2c-4622-9563-d5f2ae259254 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:30.377962 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-88838518-6d2c-4622-9563-d5f2ae259254 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:30.378421 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-88838518-6d2c-4622-9563-d5f2ae259254 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:30.378847 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-88838518-6d2c-4622-9563-d5f2ae259254 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:30.404240 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-90b42446-2421-44c9-a949-9485232af85d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:30.412328 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-90b42446-2421-44c9-a949-9485232af85d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1314 microversion: 2.1 time: 0.153222 Aug 24 17:52:30.412890 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 227/456] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:30 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:30.515291 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-88838518-6d2c-4622-9563-d5f2ae259254 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:30.524061 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-88838518-6d2c-4622-9563-d5f2ae259254 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:30.530427 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-88838518-6d2c-4622-9563-d5f2ae259254 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:30.530427 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-88838518-6d2c-4622-9563-d5f2ae259254 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.162867 Aug 24 17:52:30.530427 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 230/457] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:30 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:52:30.700497 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-7a906118-fd0d-4b59-9f62-f6b6d8dcf54a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:30.700996 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-7a906118-fd0d-4b59-9f62-f6b6d8dcf54a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:30.707260 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7a906118-fd0d-4b59-9f62-f6b6d8dcf54a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:30.707757 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7a906118-fd0d-4b59-9f62-f6b6d8dcf54a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:30.708197 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7a906118-fd0d-4b59-9f62-f6b6d8dcf54a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:30.708906 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7a906118-fd0d-4b59-9f62-f6b6d8dcf54a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:30.709361 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7a906118-fd0d-4b59-9f62-f6b6d8dcf54a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:30.709818 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7a906118-fd0d-4b59-9f62-f6b6d8dcf54a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:30.851844 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7a906118-fd0d-4b59-9f62-f6b6d8dcf54a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:30.860625 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-7a906118-fd0d-4b59-9f62-f6b6d8dcf54a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1509 microversion: 2.1 time: 0.164788 Aug 24 17:52:30.861206 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 228/458] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:30 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:31.434523 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8fe72d6a-a772-4754-adbd-d7fe1c5cab07 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:31.435133 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8fe72d6a-a772-4754-adbd-d7fe1c5cab07 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:31.441960 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8fe72d6a-a772-4754-adbd-d7fe1c5cab07 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:31.442638 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8fe72d6a-a772-4754-adbd-d7fe1c5cab07 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:31.443076 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8fe72d6a-a772-4754-adbd-d7fe1c5cab07 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:31.443779 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8fe72d6a-a772-4754-adbd-d7fe1c5cab07 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:31.444225 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8fe72d6a-a772-4754-adbd-d7fe1c5cab07 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:31.444642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8fe72d6a-a772-4754-adbd-d7fe1c5cab07 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:31.552042 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-65f1736e-93e9-4674-aa5f-b9bd00628df4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:31.553218 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-65f1736e-93e9-4674-aa5f-b9bd00628df4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:31.555728 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=2 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:31.556720 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=6 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:31.563162 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-65f1736e-93e9-4674-aa5f-b9bd00628df4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:31.563775 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-65f1736e-93e9-4674-aa5f-b9bd00628df4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:31.564240 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-65f1736e-93e9-4674-aa5f-b9bd00628df4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:31.564968 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-65f1736e-93e9-4674-aa5f-b9bd00628df4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:31.565430 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-65f1736e-93e9-4674-aa5f-b9bd00628df4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:31.565877 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-65f1736e-93e9-4674-aa5f-b9bd00628df4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:31.998618 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-65f1736e-93e9-4674-aa5f-b9bd00628df4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:32.004450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8fe72d6a-a772-4754-adbd-d7fe1c5cab07 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:32.010824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-65f1736e-93e9-4674-aa5f-b9bd00628df4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:32.013050 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-65f1736e-93e9-4674-aa5f-b9bd00628df4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:32.014579 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-65f1736e-93e9-4674-aa5f-b9bd00628df4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.466637 Aug 24 17:52:32.015329 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 229/459] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:31 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:52:32.029263 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-8fe72d6a-a772-4754-adbd-d7fe1c5cab07 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1314 microversion: 2.1 time: 0.585335 Aug 24 17:52:32.029263 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 231/460] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:31 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:32.029263 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-6ed85778-21c8-4247-b126-c94ddc0774ce tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:32.029263 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-6ed85778-21c8-4247-b126-c94ddc0774ce tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:32.029263 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6ed85778-21c8-4247-b126-c94ddc0774ce tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:32.029744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6ed85778-21c8-4247-b126-c94ddc0774ce tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:32.029744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6ed85778-21c8-4247-b126-c94ddc0774ce tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:32.030385 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6ed85778-21c8-4247-b126-c94ddc0774ce tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:32.030916 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6ed85778-21c8-4247-b126-c94ddc0774ce tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:32.031531 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6ed85778-21c8-4247-b126-c94ddc0774ce tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:32.036318 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:32.040227 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-4c972c45-ad91-4616-b8bc-93f91099dd98 req-58fdd6c3-7547-46f4-ba2d-a7d07593f70e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "154f9aac-b081-4041-ba41-dd14fb267e29", "name": "network-vif-plugged", "status": "completed", "tag": "12033839-1050-4fb0-90d7-ede010ae619a"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:32.053820 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-4c972c45-ad91-4616-b8bc-93f91099dd98 req-58fdd6c3-7547-46f4-ba2d-a7d07593f70e service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:32.058559 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-4c972c45-ad91-4616-b8bc-93f91099dd98 req-58fdd6c3-7547-46f4-ba2d-a7d07593f70e service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:32.058559 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-4c972c45-ad91-4616-b8bc-93f91099dd98 req-58fdd6c3-7547-46f4-ba2d-a7d07593f70e service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:32.067499 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-4c972c45-ad91-4616-b8bc-93f91099dd98 req-58fdd6c3-7547-46f4-ba2d-a7d07593f70e service nova] Creating event network-vif-plugged:12033839-1050-4fb0-90d7-ede010ae619a for instance 154f9aac-b081-4041-ba41-dd14fb267e29 on hv-cinder-85442 Aug 24 17:52:32.073087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-4c972c45-ad91-4616-b8bc-93f91099dd98 req-58fdd6c3-7547-46f4-ba2d-a7d07593f70e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041279 Aug 24 17:52:32.073683 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 230/461] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:52:32.242550 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-6ed85778-21c8-4247-b126-c94ddc0774ce tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:32.251032 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-6ed85778-21c8-4247-b126-c94ddc0774ce tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1509 microversion: 2.1 time: 0.233700 Aug 24 17:52:32.251610 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 232/462] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:32 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1509 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:32.625305 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-679b20e2-d1fd-4d1e-b1fd-94634edf175b req-a029ab41-8b6b-4a08-9f46-884f880dbebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a89e452a-4645-4263-acfb-2d195ceb949d", "tag": "a32d788d-e627-4b4e-98c7-b11b1d170329"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:32.635687 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-679b20e2-d1fd-4d1e-b1fd-94634edf175b req-a029ab41-8b6b-4a08-9f46-884f880dbebe service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:32.636231 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-679b20e2-d1fd-4d1e-b1fd-94634edf175b req-a029ab41-8b6b-4a08-9f46-884f880dbebe service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:32.636628 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-679b20e2-d1fd-4d1e-b1fd-94634edf175b req-a029ab41-8b6b-4a08-9f46-884f880dbebe service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:32.648156 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-679b20e2-d1fd-4d1e-b1fd-94634edf175b req-a029ab41-8b6b-4a08-9f46-884f880dbebe service nova] Creating event network-changed:a32d788d-e627-4b4e-98c7-b11b1d170329 for instance a89e452a-4645-4263-acfb-2d195ceb949d on hv-cinder-85442 Aug 24 17:52:32.654040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-679b20e2-d1fd-4d1e-b1fd-94634edf175b req-a029ab41-8b6b-4a08-9f46-884f880dbebe service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033557 Aug 24 17:52:32.654652 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 231/463] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:52:33.051611 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-1d9f2847-0f6b-49f1-b9f9-0f6f13bbe04e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:33.052203 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-45fce350-13b9-44a9-95a5-c72157aa7211 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:33.052406 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-45fce350-13b9-44a9-95a5-c72157aa7211 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:33.053249 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-1d9f2847-0f6b-49f1-b9f9-0f6f13bbe04e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:33.058303 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=2 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:33.060680 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45fce350-13b9-44a9-95a5-c72157aa7211 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:33.061187 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45fce350-13b9-44a9-95a5-c72157aa7211 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:33.061628 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45fce350-13b9-44a9-95a5-c72157aa7211 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:33.062378 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45fce350-13b9-44a9-95a5-c72157aa7211 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:33.062681 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1d9f2847-0f6b-49f1-b9f9-0f6f13bbe04e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:33.062818 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45fce350-13b9-44a9-95a5-c72157aa7211 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:33.063166 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1d9f2847-0f6b-49f1-b9f9-0f6f13bbe04e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:33.063283 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45fce350-13b9-44a9-95a5-c72157aa7211 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:33.063607 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1d9f2847-0f6b-49f1-b9f9-0f6f13bbe04e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:33.064304 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1d9f2847-0f6b-49f1-b9f9-0f6f13bbe04e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:33.064758 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1d9f2847-0f6b-49f1-b9f9-0f6f13bbe04e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:33.065183 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1d9f2847-0f6b-49f1-b9f9-0f6f13bbe04e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:33.273734 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-45fce350-13b9-44a9-95a5-c72157aa7211 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:33.284442 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-45fce350-13b9-44a9-95a5-c72157aa7211 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:33.286051 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-45fce350-13b9-44a9-95a5-c72157aa7211 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:33.287314 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-45fce350-13b9-44a9-95a5-c72157aa7211 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.239923 Aug 24 17:52:33.287912 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 232/464] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:33 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:33.291816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-1d9f2847-0f6b-49f1-b9f9-0f6f13bbe04e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:33.309304 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-8bce2da9-94f9-44e7-9e5b-1f383f43c70b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:33.310065 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-8bce2da9-94f9-44e7-9e5b-1f383f43c70b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:33.314771 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-1d9f2847-0f6b-49f1-b9f9-0f6f13bbe04e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1314 microversion: 2.1 time: 0.267423 Aug 24 17:52:33.315341 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 233/465] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:33 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:33.331892 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8bce2da9-94f9-44e7-9e5b-1f383f43c70b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:33.332396 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8bce2da9-94f9-44e7-9e5b-1f383f43c70b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:33.332842 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8bce2da9-94f9-44e7-9e5b-1f383f43c70b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:33.333564 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8bce2da9-94f9-44e7-9e5b-1f383f43c70b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:33.334080 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8bce2da9-94f9-44e7-9e5b-1f383f43c70b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:33.334686 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8bce2da9-94f9-44e7-9e5b-1f383f43c70b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:33.477332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-8bce2da9-94f9-44e7-9e5b-1f383f43c70b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:33.486418 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-8bce2da9-94f9-44e7-9e5b-1f383f43c70b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1515 microversion: 2.1 time: 0.196840 Aug 24 17:52:33.487002 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 233/466] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:33 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:34.318651 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ccd32a9c-08b3-479f-a0a2-5d8c200d6c7d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:34.319675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-ccd32a9c-08b3-479f-a0a2-5d8c200d6c7d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:34.331194 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ccd32a9c-08b3-479f-a0a2-5d8c200d6c7d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:34.333613 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ccd32a9c-08b3-479f-a0a2-5d8c200d6c7d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:34.333613 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ccd32a9c-08b3-479f-a0a2-5d8c200d6c7d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:34.334663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ccd32a9c-08b3-479f-a0a2-5d8c200d6c7d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:34.336719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ccd32a9c-08b3-479f-a0a2-5d8c200d6c7d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:34.338267 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ccd32a9c-08b3-479f-a0a2-5d8c200d6c7d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:34.346025 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-b76ff84c-3683-4464-bb9a-cbe802a5ecae tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:34.348095 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-b76ff84c-3683-4464-bb9a-cbe802a5ecae tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:34.357264 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b76ff84c-3683-4464-bb9a-cbe802a5ecae tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:34.362371 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b76ff84c-3683-4464-bb9a-cbe802a5ecae tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:34.362371 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b76ff84c-3683-4464-bb9a-cbe802a5ecae tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:34.362371 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b76ff84c-3683-4464-bb9a-cbe802a5ecae tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:34.362371 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b76ff84c-3683-4464-bb9a-cbe802a5ecae tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:34.363329 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b76ff84c-3683-4464-bb9a-cbe802a5ecae tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:34.624869 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-ccd32a9c-08b3-479f-a0a2-5d8c200d6c7d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:34.639727 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-ccd32a9c-08b3-479f-a0a2-5d8c200d6c7d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:34.642444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-b76ff84c-3683-4464-bb9a-cbe802a5ecae tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:34.642662 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-ccd32a9c-08b3-479f-a0a2-5d8c200d6c7d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:34.644507 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-ccd32a9c-08b3-479f-a0a2-5d8c200d6c7d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.335444 Aug 24 17:52:34.645485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 234/467] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:34 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:34.646113 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=100 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:34.652748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-b76ff84c-3683-4464-bb9a-cbe802a5ecae tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1314 microversion: 2.1 time: 0.315336 Aug 24 17:52:34.653784 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 234/468] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:34 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:34.752095 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-cdf06151-dcb4-4688-b8bb-b8694c91f6c1 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1107990540", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1931889606", "security_groups": [{"name": "tempest-secgroup-smoke-1999771964"}], "block_device_mapping_v2": [{"uuid": "1eaa4e60-2895-441a-b632-36426e3ba119", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2846555c-99d6-42dd-b3aa-b589c6b8e767"}]}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:34.763829 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:34.874126 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.network.neutron [None req-cdf06151-dcb4-4688-b8bb-b8694c91f6c1 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] validate_networks() for [('2846555c-99d6-42dd-b3aa-b589c6b8e767', None, None, None, None, None)] {{(pid=127676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:52:35.320130 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-add0ea6d-b310-47c9-84fc-90ecc03faf75 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Action: 'create', calling method: .version_select at 0x7fce774c68b0>, body: {"keypair": {"name": "tempest-keypair-826942031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPy/OLCktPp63dpWx1GihO6Hp69DSTBvnwu3UkLBtw7fIgpqUDUDQmFsSzYU8deiQCDZytzYtoEaN2XMUeJwT80ejuUOzSO+ZXuWmnunoMTUJx/nIOB+p3MXY8bjCRfmQA=="}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:35.342627 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-add0ea6d-b310-47c9-84fc-90ecc03faf75 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Getting quotas for project 151e9d2b290047e8acd9468c721b9dd3. Resources: {'key_pairs'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:52:35.348049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-add0ea6d-b310-47c9-84fc-90ecc03faf75 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Getting quotas for user 63ff0ea67ee64e14aafc5c51cad9684f and project 151e9d2b290047e8acd9468c721b9dd3. Resources: {'key_pairs'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:52:35.392445 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-cdf06151-dcb4-4688-b8bb-b8694c91f6c1 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Flavor limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:52:35.392986 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-cdf06151-dcb4-4688-b8bb-b8694c91f6c1 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Image limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:52:35.393387 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-cdf06151-dcb4-4688-b8bb-b8694c91f6c1 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Flavor pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:52:35.393832 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-cdf06151-dcb4-4688-b8bb-b8694c91f6c1 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Image pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:52:35.394283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-cdf06151-dcb4-4688-b8bb-b8694c91f6c1 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:52:35.405051 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cdf06151-dcb4-4688-b8bb-b8694c91f6c1 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:35.405675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cdf06151-dcb4-4688-b8bb-b8694c91f6c1 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:35.408706 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cdf06151-dcb4-4688-b8bb-b8694c91f6c1 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:35.408706 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cdf06151-dcb4-4688-b8bb-b8694c91f6c1 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:35.408706 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cdf06151-dcb4-4688-b8bb-b8694c91f6c1 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:35.408706 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cdf06151-dcb4-4688-b8bb-b8694c91f6c1 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:35.427682 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-cdf06151-dcb4-4688-b8bb-b8694c91f6c1 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Getting quotas for project 54cebab3bf1f440dbaa4ef020177a4bb. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:52:35.432429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-cdf06151-dcb4-4688-b8bb-b8694c91f6c1 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Getting quotas for user f19bf0e6a8ad425cbbf804d6d7be5a0a and project 54cebab3bf1f440dbaa4ef020177a4bb. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:52:35.465139 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-add0ea6d-b310-47c9-84fc-90ecc03faf75 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.149754 Aug 24 17:52:35.465790 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 235/469] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 17:52:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:52:35.500539 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-cdf06151-dcb4-4688-b8bb-b8694c91f6c1 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Going to run 1 instances... {{(pid=127676) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:52:35.505260 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-cdf06151-dcb4-4688-b8bb-b8694c91f6c1 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1eaa4e60-2895-441a-b632-36426e3ba119',volume_size=None,volume_type=None)] {{(pid=127676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:52:35.673731 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a25cca25-913d-410c-9044-6027541c33a6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:35.674911 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a25cca25-913d-410c-9044-6027541c33a6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:35.683575 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a25cca25-913d-410c-9044-6027541c33a6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:35.684074 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a25cca25-913d-410c-9044-6027541c33a6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:35.684512 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a25cca25-913d-410c-9044-6027541c33a6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:35.685226 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a25cca25-913d-410c-9044-6027541c33a6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:35.685677 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a25cca25-913d-410c-9044-6027541c33a6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:35.686132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a25cca25-913d-410c-9044-6027541c33a6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:35.857265 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a25cca25-913d-410c-9044-6027541c33a6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:35.870275 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a25cca25-913d-410c-9044-6027541c33a6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:35.872656 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a25cca25-913d-410c-9044-6027541c33a6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:35.874109 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a25cca25-913d-410c-9044-6027541c33a6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.209075 Aug 24 17:52:35.874837 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 236/470] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:35 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:52:35.883875 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-303ea005-78b2-46b4-971f-c6e08842cfe5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:35.884468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-303ea005-78b2-46b4-971f-c6e08842cfe5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:35.891191 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-303ea005-78b2-46b4-971f-c6e08842cfe5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:35.891687 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-303ea005-78b2-46b4-971f-c6e08842cfe5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:35.892308 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-303ea005-78b2-46b4-971f-c6e08842cfe5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:35.893377 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-303ea005-78b2-46b4-971f-c6e08842cfe5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:35.893664 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-303ea005-78b2-46b4-971f-c6e08842cfe5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:35.894339 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-303ea005-78b2-46b4-971f-c6e08842cfe5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:36.050986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-303ea005-78b2-46b4-971f-c6e08842cfe5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:36.060297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-303ea005-78b2-46b4-971f-c6e08842cfe5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1314 microversion: 2.1 time: 0.184020 Aug 24 17:52:36.060893 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 237/471] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:35 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:36.122980 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-cdf06151-dcb4-4688-b8bb-b8694c91f6c1 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.374121 Aug 24 17:52:36.125430 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 235/472] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 17:52:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:52:36.141298 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-424a4147-60bd-4df3-b7b5-099f3ec2f8a7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:36.142146 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-424a4147-60bd-4df3-b7b5-099f3ec2f8a7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:36.241947 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-424a4147-60bd-4df3-b7b5-099f3ec2f8a7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:36.254681 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-424a4147-60bd-4df3-b7b5-099f3ec2f8a7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1095 microversion: 2.1 time: 0.117379 Aug 24 17:52:36.255634 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 238/473] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:36 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1095 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:36.912512 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f0b72bbf-0522-4d1f-9f40-c441cb7c5694 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:36.913220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f0b72bbf-0522-4d1f-9f40-c441cb7c5694 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:36.929367 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f0b72bbf-0522-4d1f-9f40-c441cb7c5694 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:36.929907 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f0b72bbf-0522-4d1f-9f40-c441cb7c5694 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:36.930366 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f0b72bbf-0522-4d1f-9f40-c441cb7c5694 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:36.931110 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f0b72bbf-0522-4d1f-9f40-c441cb7c5694 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:36.931583 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f0b72bbf-0522-4d1f-9f40-c441cb7c5694 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:36.932020 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f0b72bbf-0522-4d1f-9f40-c441cb7c5694 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:37.085225 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1ce6367d-65a6-4868-a0d1-7d88abce6a6f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:37.086365 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1ce6367d-65a6-4868-a0d1-7d88abce6a6f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:37.096052 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1ce6367d-65a6-4868-a0d1-7d88abce6a6f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:37.096557 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1ce6367d-65a6-4868-a0d1-7d88abce6a6f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:37.097029 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1ce6367d-65a6-4868-a0d1-7d88abce6a6f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:37.097771 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1ce6367d-65a6-4868-a0d1-7d88abce6a6f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:37.098278 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1ce6367d-65a6-4868-a0d1-7d88abce6a6f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:37.098715 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1ce6367d-65a6-4868-a0d1-7d88abce6a6f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:37.212066 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f0b72bbf-0522-4d1f-9f40-c441cb7c5694 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:37.233093 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f0b72bbf-0522-4d1f-9f40-c441cb7c5694 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:37.235326 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f0b72bbf-0522-4d1f-9f40-c441cb7c5694 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:37.237034 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f0b72bbf-0522-4d1f-9f40-c441cb7c5694 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.329697 Aug 24 17:52:37.237590 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 236/474] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:36 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:37.282768 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a80d7ef5-e688-4d64-a117-d400e8b435ec tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:37.286015 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a80d7ef5-e688-4d64-a117-d400e8b435ec tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:37.382150 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a80d7ef5-e688-4d64-a117-d400e8b435ec tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:37.387112 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1ce6367d-65a6-4868-a0d1-7d88abce6a6f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:37.397209 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a80d7ef5-e688-4d64-a117-d400e8b435ec tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1095 microversion: 2.1 time: 0.117826 Aug 24 17:52:37.397847 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 237/475] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:37 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1095 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:37.402872 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1ce6367d-65a6-4868-a0d1-7d88abce6a6f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1314 microversion: 2.1 time: 0.322495 Aug 24 17:52:37.404135 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 239/476] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:37 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:38.260511 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e944b3e7-34b4-402e-afcc-a07b8152aee0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:38.262039 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e944b3e7-34b4-402e-afcc-a07b8152aee0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:38.268174 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e944b3e7-34b4-402e-afcc-a07b8152aee0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:38.268666 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e944b3e7-34b4-402e-afcc-a07b8152aee0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:38.269104 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e944b3e7-34b4-402e-afcc-a07b8152aee0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:38.269808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e944b3e7-34b4-402e-afcc-a07b8152aee0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:38.270298 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e944b3e7-34b4-402e-afcc-a07b8152aee0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:38.270730 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e944b3e7-34b4-402e-afcc-a07b8152aee0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:38.433148 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-b98e66fd-0eaf-4f0c-ab31-e7ff1a1aa220 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:38.434130 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-b98e66fd-0eaf-4f0c-ab31-e7ff1a1aa220 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:38.440555 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b98e66fd-0eaf-4f0c-ab31-e7ff1a1aa220 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:38.441401 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b98e66fd-0eaf-4f0c-ab31-e7ff1a1aa220 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:38.441844 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b98e66fd-0eaf-4f0c-ab31-e7ff1a1aa220 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:38.442789 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b98e66fd-0eaf-4f0c-ab31-e7ff1a1aa220 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:38.443262 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b98e66fd-0eaf-4f0c-ab31-e7ff1a1aa220 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:38.443730 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b98e66fd-0eaf-4f0c-ab31-e7ff1a1aa220 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:38.460304 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e944b3e7-34b4-402e-afcc-a07b8152aee0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:38.471370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e944b3e7-34b4-402e-afcc-a07b8152aee0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:38.473033 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e944b3e7-34b4-402e-afcc-a07b8152aee0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:38.474363 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e944b3e7-34b4-402e-afcc-a07b8152aee0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.218379 Aug 24 17:52:38.475011 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 238/477] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:38 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:38.480084 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-4d12085e-7d0e-45ef-8a0a-36c2569f2560 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:38.480709 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4d12085e-7d0e-45ef-8a0a-36c2569f2560 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:38.487265 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4d12085e-7d0e-45ef-8a0a-36c2569f2560 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:38.487764 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4d12085e-7d0e-45ef-8a0a-36c2569f2560 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:38.488207 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4d12085e-7d0e-45ef-8a0a-36c2569f2560 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:38.488918 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4d12085e-7d0e-45ef-8a0a-36c2569f2560 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:38.489382 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4d12085e-7d0e-45ef-8a0a-36c2569f2560 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:38.489811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4d12085e-7d0e-45ef-8a0a-36c2569f2560 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:38.523207 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-b98e66fd-0eaf-4f0c-ab31-e7ff1a1aa220 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:38.533386 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-b98e66fd-0eaf-4f0c-ab31-e7ff1a1aa220 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1145 microversion: 2.1 time: 0.104999 Aug 24 17:52:38.534375 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 240/478] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:38 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1145 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:38.539949 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1573620a-97f7-4d76-b0d5-44db912f0c95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1502446206", "imageRef": "2d76d745-abc6-4a7b-b8d7-46566b66934b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4dda7a94-775b-4143-b064-79a1f63c7c32"}], "security_groups": [{"name": "tempest-securitygroup--662213470"}], "key_name": "tempest-keypair-826942031", "user_data": "}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:38.673948 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-4d12085e-7d0e-45ef-8a0a-36c2569f2560 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:38.683089 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-4d12085e-7d0e-45ef-8a0a-36c2569f2560 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1314 microversion: 2.1 time: 0.205925 Aug 24 17:52:38.683400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 239/479] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:38 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:38.686591 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.network.neutron [None req-1573620a-97f7-4d76-b0d5-44db912f0c95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] validate_networks() for [('4dda7a94-775b-4143-b064-79a1f63c7c32', None, None, None, None, None)] {{(pid=127677) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:52:39.099542 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-1573620a-97f7-4d76-b0d5-44db912f0c95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Flavor limits 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:52:39.099964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-1573620a-97f7-4d76-b0d5-44db912f0c95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Image limits 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:52:39.100433 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-1573620a-97f7-4d76-b0d5-44db912f0c95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Flavor pref 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:52:39.100837 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-1573620a-97f7-4d76-b0d5-44db912f0c95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Image pref 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:52:39.101259 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-1573620a-97f7-4d76-b0d5-44db912f0c95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:52:39.111568 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1573620a-97f7-4d76-b0d5-44db912f0c95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:39.112029 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1573620a-97f7-4d76-b0d5-44db912f0c95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:39.112457 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1573620a-97f7-4d76-b0d5-44db912f0c95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:39.113171 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1573620a-97f7-4d76-b0d5-44db912f0c95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:39.113617 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1573620a-97f7-4d76-b0d5-44db912f0c95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:39.114068 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1573620a-97f7-4d76-b0d5-44db912f0c95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:39.131522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-1573620a-97f7-4d76-b0d5-44db912f0c95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Getting quotas for project 151e9d2b290047e8acd9468c721b9dd3. Resources: {'instances', 'ram', 'cores'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:52:39.136566 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-1573620a-97f7-4d76-b0d5-44db912f0c95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Getting quotas for user 63ff0ea67ee64e14aafc5c51cad9684f and project 151e9d2b290047e8acd9468c721b9dd3. Resources: {'instances', 'ram', 'cores'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:52:39.147888 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1573620a-97f7-4d76-b0d5-44db912f0c95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Going to run 1 instances... {{(pid=127677) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:52:39.150584 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1573620a-97f7-4d76-b0d5-44db912f0c95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d76d745-abc6-4a7b-b8d7-46566b66934b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:52:39.310827 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1573620a-97f7-4d76-b0d5-44db912f0c95 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.775197 Aug 24 17:52:39.311850 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 241/480] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 17:52:38 2022] POST /compute/v2.1/servers => generated 408 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:52:39.323789 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7ddab950-8ba9-4e23-9b60-0761179e75de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:39.325133 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7ddab950-8ba9-4e23-9b60-0761179e75de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:39.388597 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7ddab950-8ba9-4e23-9b60-0761179e75de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:39.397900 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7ddab950-8ba9-4e23-9b60-0761179e75de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1245 microversion: 2.1 time: 0.079115 Aug 24 17:52:39.398482 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 240/481] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:39 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:39.515346 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ad983db1-ded4-4d3c-9a36-e32b14a04297 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:39.516430 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ad983db1-ded4-4d3c-9a36-e32b14a04297 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:39.536288 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ad983db1-ded4-4d3c-9a36-e32b14a04297 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:39.536969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ad983db1-ded4-4d3c-9a36-e32b14a04297 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:39.537415 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ad983db1-ded4-4d3c-9a36-e32b14a04297 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:39.539167 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ad983db1-ded4-4d3c-9a36-e32b14a04297 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:39.539685 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ad983db1-ded4-4d3c-9a36-e32b14a04297 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:39.540125 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ad983db1-ded4-4d3c-9a36-e32b14a04297 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:39.579033 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-bda24c54-9740-4bab-a03c-86534fda369e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:39.592765 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-bda24c54-9740-4bab-a03c-86534fda369e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:39.635369 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bda24c54-9740-4bab-a03c-86534fda369e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:39.639406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bda24c54-9740-4bab-a03c-86534fda369e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:39.640324 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bda24c54-9740-4bab-a03c-86534fda369e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:39.642191 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bda24c54-9740-4bab-a03c-86534fda369e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:39.642507 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bda24c54-9740-4bab-a03c-86534fda369e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:39.643340 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bda24c54-9740-4bab-a03c-86534fda369e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:39.748819 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-bda24c54-9740-4bab-a03c-86534fda369e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:39.760662 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-bda24c54-9740-4bab-a03c-86534fda369e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1145 microversion: 2.1 time: 0.205182 Aug 24 17:52:39.761361 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 241/482] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:39 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1145 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:39.779755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0c932379-5884-45b6-ad4f-1ce76808b503 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:39.781209 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0c932379-5884-45b6-ad4f-1ce76808b503 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:39.792114 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c932379-5884-45b6-ad4f-1ce76808b503 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:39.793122 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c932379-5884-45b6-ad4f-1ce76808b503 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:39.794109 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c932379-5884-45b6-ad4f-1ce76808b503 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:39.795002 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c932379-5884-45b6-ad4f-1ce76808b503 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:39.796415 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c932379-5884-45b6-ad4f-1ce76808b503 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:39.796920 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c932379-5884-45b6-ad4f-1ce76808b503 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:39.805358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-ad983db1-ded4-4d3c-9a36-e32b14a04297 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:39.815608 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-ad983db1-ded4-4d3c-9a36-e32b14a04297 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:39.817419 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-ad983db1-ded4-4d3c-9a36-e32b14a04297 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:39.818857 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ad983db1-ded4-4d3c-9a36-e32b14a04297 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.311658 Aug 24 17:52:39.819428 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 242/483] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:39 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:39.976406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0c932379-5884-45b6-ad4f-1ce76808b503 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:39.985606 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0c932379-5884-45b6-ad4f-1ce76808b503 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1314 microversion: 2.1 time: 0.222402 Aug 24 17:52:39.985778 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 242/484] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:39 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:40.419348 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-63a127aa-8271-45ed-b50a-a01a368f712b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:40.420119 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-63a127aa-8271-45ed-b50a-a01a368f712b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:40.481573 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-63a127aa-8271-45ed-b50a-a01a368f712b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:40.488523 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-63a127aa-8271-45ed-b50a-a01a368f712b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1245 microversion: 2.1 time: 0.073412 Aug 24 17:52:40.489110 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 243/485] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:40 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1245 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:40.790787 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0a1f2ff6-a059-49a2-9180-75778c9c510b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:40.791681 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0a1f2ff6-a059-49a2-9180-75778c9c510b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:40.799214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0a1f2ff6-a059-49a2-9180-75778c9c510b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:40.799705 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0a1f2ff6-a059-49a2-9180-75778c9c510b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:40.800140 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0a1f2ff6-a059-49a2-9180-75778c9c510b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:40.800957 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0a1f2ff6-a059-49a2-9180-75778c9c510b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:40.801529 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0a1f2ff6-a059-49a2-9180-75778c9c510b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:40.802107 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0a1f2ff6-a059-49a2-9180-75778c9c510b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:40.843346 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f4c91a2d-328e-4aaf-bfa0-b11a9c3ec53e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:40.844138 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-f4c91a2d-328e-4aaf-bfa0-b11a9c3ec53e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:40.851343 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f4c91a2d-328e-4aaf-bfa0-b11a9c3ec53e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:40.851939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f4c91a2d-328e-4aaf-bfa0-b11a9c3ec53e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:40.852447 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f4c91a2d-328e-4aaf-bfa0-b11a9c3ec53e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:40.853216 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f4c91a2d-328e-4aaf-bfa0-b11a9c3ec53e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:40.853794 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f4c91a2d-328e-4aaf-bfa0-b11a9c3ec53e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:40.854649 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f4c91a2d-328e-4aaf-bfa0-b11a9c3ec53e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:40.872385 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0a1f2ff6-a059-49a2-9180-75778c9c510b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:40.881049 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0a1f2ff6-a059-49a2-9180-75778c9c510b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1193 microversion: 2.1 time: 0.093934 Aug 24 17:52:40.881643 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 243/486] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:40 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1193 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:41.005313 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f4c91a2d-328e-4aaf-bfa0-b11a9c3ec53e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:41.012586 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-45195650-4c14-4f8f-9d3d-7c8b0da7c948 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:41.013234 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-45195650-4c14-4f8f-9d3d-7c8b0da7c948 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:41.016335 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f4c91a2d-328e-4aaf-bfa0-b11a9c3ec53e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:41.017977 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f4c91a2d-328e-4aaf-bfa0-b11a9c3ec53e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:41.019300 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-f4c91a2d-328e-4aaf-bfa0-b11a9c3ec53e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.179936 Aug 24 17:52:41.019477 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-45195650-4c14-4f8f-9d3d-7c8b0da7c948 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:41.019880 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-45195650-4c14-4f8f-9d3d-7c8b0da7c948 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:41.020311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-45195650-4c14-4f8f-9d3d-7c8b0da7c948 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:41.020414 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 244/487] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:40 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:41.021008 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-45195650-4c14-4f8f-9d3d-7c8b0da7c948 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:41.021452 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-45195650-4c14-4f8f-9d3d-7c8b0da7c948 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:41.021903 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-45195650-4c14-4f8f-9d3d-7c8b0da7c948 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:41.173619 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-45195650-4c14-4f8f-9d3d-7c8b0da7c948 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:41.182192 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-45195650-4c14-4f8f-9d3d-7c8b0da7c948 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1314 microversion: 2.1 time: 0.173313 Aug 24 17:52:41.182765 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 244/488] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:41 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:41.509497 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4d48c9d3-7fd0-41b5-a0c3-3732e5101538 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:41.510277 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4d48c9d3-7fd0-41b5-a0c3-3732e5101538 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:41.516408 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4d48c9d3-7fd0-41b5-a0c3-3732e5101538 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:41.516884 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4d48c9d3-7fd0-41b5-a0c3-3732e5101538 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:41.517311 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4d48c9d3-7fd0-41b5-a0c3-3732e5101538 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:41.518065 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4d48c9d3-7fd0-41b5-a0c3-3732e5101538 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:41.518519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4d48c9d3-7fd0-41b5-a0c3-3732e5101538 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:41.518942 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4d48c9d3-7fd0-41b5-a0c3-3732e5101538 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:41.583319 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-4d48c9d3-7fd0-41b5-a0c3-3732e5101538 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:41.592577 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-4d48c9d3-7fd0-41b5-a0c3-3732e5101538 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1249 microversion: 2.1 time: 0.086860 Aug 24 17:52:41.593163 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 245/489] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:41 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:41.904175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-02df7b02-ff08-4557-a6d4-da0c87ab6aa0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:41.904791 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-02df7b02-ff08-4557-a6d4-da0c87ab6aa0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:41.911346 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-02df7b02-ff08-4557-a6d4-da0c87ab6aa0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:41.911844 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-02df7b02-ff08-4557-a6d4-da0c87ab6aa0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:41.912284 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-02df7b02-ff08-4557-a6d4-da0c87ab6aa0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:41.912995 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-02df7b02-ff08-4557-a6d4-da0c87ab6aa0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:41.913461 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-02df7b02-ff08-4557-a6d4-da0c87ab6aa0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:41.913912 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-02df7b02-ff08-4557-a6d4-da0c87ab6aa0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:41.978285 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-02df7b02-ff08-4557-a6d4-da0c87ab6aa0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:41.987103 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-02df7b02-ff08-4557-a6d4-da0c87ab6aa0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1193 microversion: 2.1 time: 0.086935 Aug 24 17:52:41.987686 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 245/490] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:41 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:42.044535 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ee1af99e-a913-484d-9709-182f0bccbda5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:42.045145 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ee1af99e-a913-484d-9709-182f0bccbda5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:42.052066 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee1af99e-a913-484d-9709-182f0bccbda5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:42.052557 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee1af99e-a913-484d-9709-182f0bccbda5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:42.052989 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee1af99e-a913-484d-9709-182f0bccbda5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:42.053693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee1af99e-a913-484d-9709-182f0bccbda5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:42.054200 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee1af99e-a913-484d-9709-182f0bccbda5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:42.054619 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee1af99e-a913-484d-9709-182f0bccbda5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:42.203360 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-6a0e4ae1-61a9-45b3-a0ed-84034814ee3e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:42.203818 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-ee1af99e-a913-484d-9709-182f0bccbda5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:42.203980 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-6a0e4ae1-61a9-45b3-a0ed-84034814ee3e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:42.211648 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6a0e4ae1-61a9-45b3-a0ed-84034814ee3e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:42.213369 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6a0e4ae1-61a9-45b3-a0ed-84034814ee3e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:42.214003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-ee1af99e-a913-484d-9709-182f0bccbda5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:42.214322 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6a0e4ae1-61a9-45b3-a0ed-84034814ee3e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:42.215603 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6a0e4ae1-61a9-45b3-a0ed-84034814ee3e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:42.215727 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-ee1af99e-a913-484d-9709-182f0bccbda5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:42.216423 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6a0e4ae1-61a9-45b3-a0ed-84034814ee3e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:42.216785 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ee1af99e-a913-484d-9709-182f0bccbda5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.176959 Aug 24 17:52:42.217020 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6a0e4ae1-61a9-45b3-a0ed-84034814ee3e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:42.217359 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 246/491] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:42 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:42.380728 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-6a0e4ae1-61a9-45b3-a0ed-84034814ee3e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:42.389476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-6a0e4ae1-61a9-45b3-a0ed-84034814ee3e tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1314 microversion: 2.1 time: 0.189856 Aug 24 17:52:42.390103 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 246/492] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:42 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:42.520284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0d2dde2c-f38a-44ba-8364-a38ca3fb650c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:42.520775 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0d2dde2c-f38a-44ba-8364-a38ca3fb650c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:42.532292 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0d2dde2c-f38a-44ba-8364-a38ca3fb650c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:42.540130 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0d2dde2c-f38a-44ba-8364-a38ca3fb650c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:42.540130 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0d2dde2c-f38a-44ba-8364-a38ca3fb650c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:42.540130 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0d2dde2c-f38a-44ba-8364-a38ca3fb650c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:42.540130 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0d2dde2c-f38a-44ba-8364-a38ca3fb650c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:42.540547 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0d2dde2c-f38a-44ba-8364-a38ca3fb650c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:42.561772 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0d2dde2c-f38a-44ba-8364-a38ca3fb650c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785/ips" status: 200 len: 150 microversion: 2.1 time: 0.045386 Aug 24 17:52:42.562392 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 247/493] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 24 17:52:42 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:52:42.575083 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-6648172a-002f-4273-b9bb-5bdcafca73ee tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b267c041-ab30-43cd-9d46-5b63aab4e10d"}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:42.577573 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-6648172a-002f-4273-b9bb-5bdcafca73ee tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:42.583861 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6648172a-002f-4273-b9bb-5bdcafca73ee tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:42.584354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6648172a-002f-4273-b9bb-5bdcafca73ee tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:42.584797 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6648172a-002f-4273-b9bb-5bdcafca73ee tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:42.585509 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6648172a-002f-4273-b9bb-5bdcafca73ee tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:42.585998 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6648172a-002f-4273-b9bb-5bdcafca73ee tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:42.586432 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6648172a-002f-4273-b9bb-5bdcafca73ee tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:42.615090 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-50c22576-f082-4576-baf7-04145ca6811c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:42.616224 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-50c22576-f082-4576-baf7-04145ca6811c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:42.623072 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-50c22576-f082-4576-baf7-04145ca6811c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:42.623587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-50c22576-f082-4576-baf7-04145ca6811c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:42.624105 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-50c22576-f082-4576-baf7-04145ca6811c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:42.624787 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-50c22576-f082-4576-baf7-04145ca6811c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:42.625156 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-50c22576-f082-4576-baf7-04145ca6811c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:42.625659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-50c22576-f082-4576-baf7-04145ca6811c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:42.678064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-6648172a-002f-4273-b9bb-5bdcafca73ee tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] HTTP exception thrown: Invalid volume: volume b267c041-ab30-43cd-9d46-5b63aab4e10d is already attached to instances: 8cd743b2-3b6c-4213-819a-1a25314ed5e2 Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-6648172a-002f-4273-b9bb-5bdcafca73ee tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Request method failure captured: Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: POST /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785/os-volume_attachments HTTP/1.1 Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 74 Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmSbnOSGx7e91Bj6OLQvb6olH3rhtuwbwgCFF2TiEJuGnQyAMTLci2PNua_H1N1Jgo-7CaRuKelcRsW8AHd-7NBHe9Qv1DY7-HELa-jl_G34ACZrF6UPOZU70uNjUu-29pkZxRoJdko5GsGgd7qyf34-jqX4JFHPGtUaryYBDPnp0Vk Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:52:42.679818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:52:42.682141 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0a4d7fadea104c569ca29ff9be48089a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:52:42.682141 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:52:42.682141 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:52:42.682141 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:52:42.682141 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:52:42.682141 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:52:42.682141 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:52:42.682141 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 251bc85f89774142a97acd77895b14e9 Aug 24 17:52:42.682141 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:52:42.682141 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Aug 24 17:52:42.682141 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {"volumeAttachment": {"volumeId": "b267c041-ab30-43cd-9d46-5b63aab4e10d"}} Aug 24 17:52:42.682141 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:52:42.683311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Invalid volume: volume b267c041-ab30-43cd-9d46-5b63aab4e10d is already attached to instances: 8cd743b2-3b6c-4213-819a-1a25314ed5e2 Aug 24 17:52:42.683311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'server_id': 'e96b5e63-7140-4b8b-99e9-005627134785', 'body': {'volumeAttachment': {'volumeId': 'b267c041-ab30-43cd-9d46-5b63aab4e10d'}}} Aug 24 17:52:42.683311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:52:42.683311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:42.683311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 17:52:42.683311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 17:52:42.683311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 17:52:42.683311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 17:52:42.683311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 17:52:42.683311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 17:52:42.683311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 17:52:42.683311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 17:52:42.683311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 17:52:42.683311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 17:52:42.683311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b267c041-ab30-43cd-9d46-5b63aab4e10d is already attached to instances: 8cd743b2-3b6c-4213-819a-1a25314ed5e2 Aug 24 17:52:42.683311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:52:42.683311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:52:42.683311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:52:42.683311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b267c041-ab30-43cd-9d46-5b63aab4e10d is already attached to instances: 8cd743b2-3b6c-4213-819a-1a25314ed5e2 Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:42.684605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:52:42.686262 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:52:42.686262 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:52:42.686262 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:52:42.686262 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b267c041-ab30-43cd-9d46-5b63aab4e10d is already attached to instances: 8cd743b2-3b6c-4213-819a-1a25314ed5e2 Aug 24 17:52:42.686262 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:52:42.686262 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-6648172a-002f-4273-b9bb-5bdcafca73ee tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Returning 400 to user: Invalid volume: volume b267c041-ab30-43cd-9d46-5b63aab4e10d is already attached to instances: 8cd743b2-3b6c-4213-819a-1a25314ed5e2 {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:52:42.686262 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-6648172a-002f-4273-b9bb-5bdcafca73ee tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "POST /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111317 Aug 24 17:52:42.686262 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 247/494] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 17:52:42 2022] POST /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:52:42.691260 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-76f87c08-e189-4003-8a8c-e9d92a903bdd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:42.691797 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-76f87c08-e189-4003-8a8c-e9d92a903bdd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:42.698368 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-50c22576-f082-4576-baf7-04145ca6811c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:42.699784 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-76f87c08-e189-4003-8a8c-e9d92a903bdd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:42.700361 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-76f87c08-e189-4003-8a8c-e9d92a903bdd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:42.700960 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-76f87c08-e189-4003-8a8c-e9d92a903bdd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:42.701505 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-76f87c08-e189-4003-8a8c-e9d92a903bdd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:42.702002 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-76f87c08-e189-4003-8a8c-e9d92a903bdd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:42.702431 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-76f87c08-e189-4003-8a8c-e9d92a903bdd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:42.705326 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-50c22576-f082-4576-baf7-04145ca6811c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1249 microversion: 2.1 time: 0.094670 Aug 24 17:52:42.705933 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 248/495] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:42 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:42.732339 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-76f87c08-e189-4003-8a8c-e9d92a903bdd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Going to try to terminate instance {{(pid=127676) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:52:43.009418 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-7b1b4518-1bfd-4da7-a6e7-48d46657eb69 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:43.010689 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-7b1b4518-1bfd-4da7-a6e7-48d46657eb69 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:43.017271 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7b1b4518-1bfd-4da7-a6e7-48d46657eb69 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.017770 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7b1b4518-1bfd-4da7-a6e7-48d46657eb69 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.018238 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7b1b4518-1bfd-4da7-a6e7-48d46657eb69 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.018973 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7b1b4518-1bfd-4da7-a6e7-48d46657eb69 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.019449 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7b1b4518-1bfd-4da7-a6e7-48d46657eb69 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.020019 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7b1b4518-1bfd-4da7-a6e7-48d46657eb69 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.057384 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-76f87c08-e189-4003-8a8c-e9d92a903bdd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 204 len: 0 microversion: 2.1 time: 0.369259 Aug 24 17:52:43.058144 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 248/496] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:52:42 2022] DELETE /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:52:43.071075 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-983b97da-3d6e-4873-8857-b1b18cc00a94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:43.072911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-983b97da-3d6e-4873-8857-b1b18cc00a94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:43.080594 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-983b97da-3d6e-4873-8857-b1b18cc00a94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.081098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-983b97da-3d6e-4873-8857-b1b18cc00a94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.081541 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-983b97da-3d6e-4873-8857-b1b18cc00a94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.082313 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-983b97da-3d6e-4873-8857-b1b18cc00a94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.082774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-983b97da-3d6e-4873-8857-b1b18cc00a94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.083208 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-983b97da-3d6e-4873-8857-b1b18cc00a94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.090686 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7b1b4518-1bfd-4da7-a6e7-48d46657eb69 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:43.099243 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-7b1b4518-1bfd-4da7-a6e7-48d46657eb69 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1193 microversion: 2.1 time: 0.094209 Aug 24 17:52:43.099820 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 249/497] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:43 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1193 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:43.232511 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-983b97da-3d6e-4873-8857-b1b18cc00a94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:43.236442 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:43.242112 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-983b97da-3d6e-4873-8857-b1b18cc00a94 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1681 microversion: 2.1 time: 0.179482 Aug 24 17:52:43.242670 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 249/498] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:43 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:43.244821 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-bec8e40a-8841-49c1-b24e-adf7bcd768f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:43.245507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-bec8e40a-8841-49c1-b24e-adf7bcd768f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:43.253062 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bec8e40a-8841-49c1-b24e-adf7bcd768f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.253714 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bec8e40a-8841-49c1-b24e-adf7bcd768f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.254302 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bec8e40a-8841-49c1-b24e-adf7bcd768f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.255291 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bec8e40a-8841-49c1-b24e-adf7bcd768f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.255874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bec8e40a-8841-49c1-b24e-adf7bcd768f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.256424 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bec8e40a-8841-49c1-b24e-adf7bcd768f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.412941 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-bb370d95-cb14-4356-a729-aa04fb3d3875 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:43.414543 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-bb370d95-cb14-4356-a729-aa04fb3d3875 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:43.422441 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bb370d95-cb14-4356-a729-aa04fb3d3875 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.422804 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bb370d95-cb14-4356-a729-aa04fb3d3875 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.423474 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bb370d95-cb14-4356-a729-aa04fb3d3875 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.424205 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bb370d95-cb14-4356-a729-aa04fb3d3875 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.424652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bb370d95-cb14-4356-a729-aa04fb3d3875 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.425243 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bb370d95-cb14-4356-a729-aa04fb3d3875 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.463193 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-bec8e40a-8841-49c1-b24e-adf7bcd768f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:43.479909 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-bec8e40a-8841-49c1-b24e-adf7bcd768f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:43.481723 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-bec8e40a-8841-49c1-b24e-adf7bcd768f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:43.483638 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-bec8e40a-8841-49c1-b24e-adf7bcd768f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1806 microversion: 2.20 time: 0.244610 Aug 24 17:52:43.484306 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 250/499] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:43 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1806 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:52:43.599292 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-bb370d95-cb14-4356-a729-aa04fb3d3875 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:43.609285 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-bb370d95-cb14-4356-a729-aa04fb3d3875 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1314 microversion: 2.1 time: 0.201225 Aug 24 17:52:43.611021 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 250/500] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:43 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:43.728080 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c1b4eec0-bab1-412a-992f-103af5fb5b23 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:43.729731 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c1b4eec0-bab1-412a-992f-103af5fb5b23 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:43.738310 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c1b4eec0-bab1-412a-992f-103af5fb5b23 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.739036 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c1b4eec0-bab1-412a-992f-103af5fb5b23 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.739547 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c1b4eec0-bab1-412a-992f-103af5fb5b23 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.740598 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c1b4eec0-bab1-412a-992f-103af5fb5b23 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.741278 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c1b4eec0-bab1-412a-992f-103af5fb5b23 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.741904 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c1b4eec0-bab1-412a-992f-103af5fb5b23 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.835732 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c1b4eec0-bab1-412a-992f-103af5fb5b23 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:43.844036 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c1b4eec0-bab1-412a-992f-103af5fb5b23 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1249 microversion: 2.1 time: 0.121156 Aug 24 17:52:43.844617 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 251/501] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:43 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1249 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:44.124371 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-abc66b98-fc56-4c07-8f41-8da07adf8e04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:44.125249 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-abc66b98-fc56-4c07-8f41-8da07adf8e04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:44.134437 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-abc66b98-fc56-4c07-8f41-8da07adf8e04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:44.135298 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-abc66b98-fc56-4c07-8f41-8da07adf8e04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:44.135877 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-abc66b98-fc56-4c07-8f41-8da07adf8e04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:44.136598 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-abc66b98-fc56-4c07-8f41-8da07adf8e04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:44.137046 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-abc66b98-fc56-4c07-8f41-8da07adf8e04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:44.137653 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-abc66b98-fc56-4c07-8f41-8da07adf8e04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:44.204529 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-abc66b98-fc56-4c07-8f41-8da07adf8e04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:44.212456 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-abc66b98-fc56-4c07-8f41-8da07adf8e04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1201 microversion: 2.1 time: 0.095725 Aug 24 17:52:44.213068 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 251/502] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:44 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1201 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:44.266420 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-b83396bb-60ec-47b1-8439-37b413d10af2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:44.266943 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-b83396bb-60ec-47b1-8439-37b413d10af2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:44.273499 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b83396bb-60ec-47b1-8439-37b413d10af2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:44.274042 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b83396bb-60ec-47b1-8439-37b413d10af2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:44.274735 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b83396bb-60ec-47b1-8439-37b413d10af2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:44.275486 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b83396bb-60ec-47b1-8439-37b413d10af2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:44.275944 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b83396bb-60ec-47b1-8439-37b413d10af2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:44.276373 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b83396bb-60ec-47b1-8439-37b413d10af2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:44.428773 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-b83396bb-60ec-47b1-8439-37b413d10af2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:44.437572 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-b83396bb-60ec-47b1-8439-37b413d10af2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1681 microversion: 2.1 time: 0.175088 Aug 24 17:52:44.438193 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 252/503] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:44 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:44.527523 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b2debab7-30a1-4c07-ab55-3b427a2a519f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:44.528341 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-b2debab7-30a1-4c07-ab55-3b427a2a519f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:44.538180 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b2debab7-30a1-4c07-ab55-3b427a2a519f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:44.538806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b2debab7-30a1-4c07-ab55-3b427a2a519f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:44.539529 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b2debab7-30a1-4c07-ab55-3b427a2a519f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:44.540704 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b2debab7-30a1-4c07-ab55-3b427a2a519f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:44.542239 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b2debab7-30a1-4c07-ab55-3b427a2a519f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:44.542811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b2debab7-30a1-4c07-ab55-3b427a2a519f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:44.632123 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-10e3ff8f-8fb4-46e1-8b5b-8e1dc347bfb5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:44.632751 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-10e3ff8f-8fb4-46e1-8b5b-8e1dc347bfb5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:44.639121 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-10e3ff8f-8fb4-46e1-8b5b-8e1dc347bfb5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:44.639619 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-10e3ff8f-8fb4-46e1-8b5b-8e1dc347bfb5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:44.640079 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-10e3ff8f-8fb4-46e1-8b5b-8e1dc347bfb5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:44.640779 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-10e3ff8f-8fb4-46e1-8b5b-8e1dc347bfb5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:44.641241 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-10e3ff8f-8fb4-46e1-8b5b-8e1dc347bfb5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:44.641670 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-10e3ff8f-8fb4-46e1-8b5b-8e1dc347bfb5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:44.736369 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b2debab7-30a1-4c07-ab55-3b427a2a519f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:44.751191 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b2debab7-30a1-4c07-ab55-3b427a2a519f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:44.753261 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b2debab7-30a1-4c07-ab55-3b427a2a519f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:44.754515 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b2debab7-30a1-4c07-ab55-3b427a2a519f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1793 microversion: 2.20 time: 0.234765 Aug 24 17:52:44.755102 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 252/504] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:44 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1793 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:44.820120 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-10e3ff8f-8fb4-46e1-8b5b-8e1dc347bfb5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:44.831681 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-10e3ff8f-8fb4-46e1-8b5b-8e1dc347bfb5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1314 microversion: 2.1 time: 0.203363 Aug 24 17:52:44.832843 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 253/505] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:44 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:44.865902 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-11b3da9f-4818-4444-9330-88a4a6612b0d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:44.866521 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-11b3da9f-4818-4444-9330-88a4a6612b0d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:44.873759 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-11b3da9f-4818-4444-9330-88a4a6612b0d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:44.874291 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-11b3da9f-4818-4444-9330-88a4a6612b0d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:44.874736 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-11b3da9f-4818-4444-9330-88a4a6612b0d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:44.875465 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-11b3da9f-4818-4444-9330-88a4a6612b0d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:44.875928 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-11b3da9f-4818-4444-9330-88a4a6612b0d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:44.876357 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-11b3da9f-4818-4444-9330-88a4a6612b0d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:44.956396 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-11b3da9f-4818-4444-9330-88a4a6612b0d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:44.964991 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-11b3da9f-4818-4444-9330-88a4a6612b0d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1249 microversion: 2.1 time: 0.103062 Aug 24 17:52:44.965636 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 253/506] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:44 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1249 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:45.234332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3c3c24ed-3157-43c5-b746-822576f6f9b3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:45.234944 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3c3c24ed-3157-43c5-b746-822576f6f9b3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:45.247747 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c3c24ed-3157-43c5-b746-822576f6f9b3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:45.248238 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c3c24ed-3157-43c5-b746-822576f6f9b3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:45.248671 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c3c24ed-3157-43c5-b746-822576f6f9b3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:45.249376 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c3c24ed-3157-43c5-b746-822576f6f9b3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:45.249825 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c3c24ed-3157-43c5-b746-822576f6f9b3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:45.250279 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c3c24ed-3157-43c5-b746-822576f6f9b3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:45.324382 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3c3c24ed-3157-43c5-b746-822576f6f9b3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:45.334299 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3c3c24ed-3157-43c5-b746-822576f6f9b3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1211 microversion: 2.1 time: 0.103675 Aug 24 17:52:45.334791 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 254/507] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:45 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1211 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:45.458248 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-98bc3cef-66ce-4c8f-9d60-8b5def3c13dd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:45.459062 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-98bc3cef-66ce-4c8f-9d60-8b5def3c13dd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:45.461274 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=2 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:45.467125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98bc3cef-66ce-4c8f-9d60-8b5def3c13dd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:45.467676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98bc3cef-66ce-4c8f-9d60-8b5def3c13dd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:45.468113 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98bc3cef-66ce-4c8f-9d60-8b5def3c13dd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:45.468821 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98bc3cef-66ce-4c8f-9d60-8b5def3c13dd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:45.474759 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98bc3cef-66ce-4c8f-9d60-8b5def3c13dd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:45.474759 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98bc3cef-66ce-4c8f-9d60-8b5def3c13dd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:45.638731 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-98bc3cef-66ce-4c8f-9d60-8b5def3c13dd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:45.647372 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-98bc3cef-66ce-4c8f-9d60-8b5def3c13dd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1681 microversion: 2.1 time: 0.193101 Aug 24 17:52:45.647956 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 254/508] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:45 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1681 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:45.853015 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a42bcba9-e8e4-40d3-a4de-e36f886ffb96 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:45.853796 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a42bcba9-e8e4-40d3-a4de-e36f886ffb96 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:45.860231 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a42bcba9-e8e4-40d3-a4de-e36f886ffb96 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:45.860719 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a42bcba9-e8e4-40d3-a4de-e36f886ffb96 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:45.861192 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a42bcba9-e8e4-40d3-a4de-e36f886ffb96 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:45.861914 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a42bcba9-e8e4-40d3-a4de-e36f886ffb96 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:45.862374 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a42bcba9-e8e4-40d3-a4de-e36f886ffb96 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:45.862809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a42bcba9-e8e4-40d3-a4de-e36f886ffb96 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:45.883689 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=100 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:45.987527 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-69e77fb8-f17d-4d76-b96b-2994f51044bb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:45.988136 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-69e77fb8-f17d-4d76-b96b-2994f51044bb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:45.994756 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69e77fb8-f17d-4d76-b96b-2994f51044bb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:45.995248 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69e77fb8-f17d-4d76-b96b-2994f51044bb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:45.995689 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69e77fb8-f17d-4d76-b96b-2994f51044bb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:45.996392 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69e77fb8-f17d-4d76-b96b-2994f51044bb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:45.996927 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69e77fb8-f17d-4d76-b96b-2994f51044bb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:45.997358 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69e77fb8-f17d-4d76-b96b-2994f51044bb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:46.008621 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a42bcba9-e8e4-40d3-a4de-e36f886ffb96 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:46.017610 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a42bcba9-e8e4-40d3-a4de-e36f886ffb96 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1314 microversion: 2.1 time: 0.168514 Aug 24 17:52:46.018502 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 255/509] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:45 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:46.061015 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-69e77fb8-f17d-4d76-b96b-2994f51044bb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:46.069032 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-69e77fb8-f17d-4d76-b96b-2994f51044bb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1241 microversion: 2.1 time: 0.085387 Aug 24 17:52:46.069660 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 255/510] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:45 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:46.359448 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1b078182-c36c-46a7-9eda-a2b047df1286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:46.360063 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1b078182-c36c-46a7-9eda-a2b047df1286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:46.362533 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:46.367273 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1b078182-c36c-46a7-9eda-a2b047df1286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:46.367761 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1b078182-c36c-46a7-9eda-a2b047df1286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:46.368204 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1b078182-c36c-46a7-9eda-a2b047df1286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:46.369687 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1b078182-c36c-46a7-9eda-a2b047df1286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:46.370267 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1b078182-c36c-46a7-9eda-a2b047df1286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:46.370696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1b078182-c36c-46a7-9eda-a2b047df1286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:46.439576 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1b078182-c36c-46a7-9eda-a2b047df1286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:46.447973 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1b078182-c36c-46a7-9eda-a2b047df1286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1211 microversion: 2.1 time: 0.092353 Aug 24 17:52:46.448552 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 256/511] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:46 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:46.673334 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-19cfec5c-5fda-4b55-8c41-9993c30c407a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:46.674122 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-19cfec5c-5fda-4b55-8c41-9993c30c407a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:46.680090 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-19cfec5c-5fda-4b55-8c41-9993c30c407a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:46.680584 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-19cfec5c-5fda-4b55-8c41-9993c30c407a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:46.681023 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-19cfec5c-5fda-4b55-8c41-9993c30c407a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:46.681985 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-19cfec5c-5fda-4b55-8c41-9993c30c407a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:46.682591 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-19cfec5c-5fda-4b55-8c41-9993c30c407a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:46.683014 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-19cfec5c-5fda-4b55-8c41-9993c30c407a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:46.819871 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-19cfec5c-5fda-4b55-8c41-9993c30c407a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:46.828625 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-19cfec5c-5fda-4b55-8c41-9993c30c407a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1681 microversion: 2.1 time: 0.159235 Aug 24 17:52:46.829216 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 256/512] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:46 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:47.039512 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d35ce16d-4f8a-4ca4-9d1d-43586fc9902f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:47.040198 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d35ce16d-4f8a-4ca4-9d1d-43586fc9902f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:47.047761 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d35ce16d-4f8a-4ca4-9d1d-43586fc9902f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:47.048294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d35ce16d-4f8a-4ca4-9d1d-43586fc9902f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:47.048742 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d35ce16d-4f8a-4ca4-9d1d-43586fc9902f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:47.049462 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d35ce16d-4f8a-4ca4-9d1d-43586fc9902f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:47.049961 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d35ce16d-4f8a-4ca4-9d1d-43586fc9902f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:47.050396 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d35ce16d-4f8a-4ca4-9d1d-43586fc9902f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:47.091237 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-26391d25-d50c-4166-bcaa-f38b332ccd61 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:47.091855 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-26391d25-d50c-4166-bcaa-f38b332ccd61 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:47.098189 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-26391d25-d50c-4166-bcaa-f38b332ccd61 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:47.098806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-26391d25-d50c-4166-bcaa-f38b332ccd61 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:47.099359 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-26391d25-d50c-4166-bcaa-f38b332ccd61 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:47.100231 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-26391d25-d50c-4166-bcaa-f38b332ccd61 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:47.100768 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-26391d25-d50c-4166-bcaa-f38b332ccd61 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:47.101279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-26391d25-d50c-4166-bcaa-f38b332ccd61 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:47.183039 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-26391d25-d50c-4166-bcaa-f38b332ccd61 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:47.191225 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-26391d25-d50c-4166-bcaa-f38b332ccd61 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1241 microversion: 2.1 time: 0.104389 Aug 24 17:52:47.192138 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 257/513] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:47 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:47.230584 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d35ce16d-4f8a-4ca4-9d1d-43586fc9902f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:47.247856 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d35ce16d-4f8a-4ca4-9d1d-43586fc9902f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1314 microversion: 2.1 time: 0.212074 Aug 24 17:52:47.248637 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 257/514] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:47 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:47.469502 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-bcce78cd-8029-4005-b974-7d332dd294a8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:47.470146 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-bcce78cd-8029-4005-b974-7d332dd294a8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:47.476714 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bcce78cd-8029-4005-b974-7d332dd294a8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:47.477027 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bcce78cd-8029-4005-b974-7d332dd294a8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:47.477482 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bcce78cd-8029-4005-b974-7d332dd294a8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:47.478891 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bcce78cd-8029-4005-b974-7d332dd294a8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:47.479391 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bcce78cd-8029-4005-b974-7d332dd294a8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:47.479826 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bcce78cd-8029-4005-b974-7d332dd294a8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:47.546142 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-bcce78cd-8029-4005-b974-7d332dd294a8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:47.554531 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-bcce78cd-8029-4005-b974-7d332dd294a8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1211 microversion: 2.1 time: 0.088952 Aug 24 17:52:47.555116 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 258/515] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:47 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:47.850727 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0188ddc3-89c1-41f4-a32b-c8b9ef729aed tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:47.851563 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0188ddc3-89c1-41f4-a32b-c8b9ef729aed tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:47.858743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0188ddc3-89c1-41f4-a32b-c8b9ef729aed tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:47.859236 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0188ddc3-89c1-41f4-a32b-c8b9ef729aed tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:47.859732 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0188ddc3-89c1-41f4-a32b-c8b9ef729aed tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:47.860450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0188ddc3-89c1-41f4-a32b-c8b9ef729aed tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:47.861278 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0188ddc3-89c1-41f4-a32b-c8b9ef729aed tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:47.861429 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0188ddc3-89c1-41f4-a32b-c8b9ef729aed tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:48.026629 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0188ddc3-89c1-41f4-a32b-c8b9ef729aed tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:48.036056 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0188ddc3-89c1-41f4-a32b-c8b9ef729aed tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1681 microversion: 2.1 time: 0.189693 Aug 24 17:52:48.036628 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 258/516] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:47 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:48.212760 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-aaf406b5-e55b-42fb-9c09-956b8e7a3af2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:48.213454 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-aaf406b5-e55b-42fb-9c09-956b8e7a3af2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:48.220042 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-aaf406b5-e55b-42fb-9c09-956b8e7a3af2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:48.220540 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-aaf406b5-e55b-42fb-9c09-956b8e7a3af2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:48.220979 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-aaf406b5-e55b-42fb-9c09-956b8e7a3af2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:48.225475 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-aaf406b5-e55b-42fb-9c09-956b8e7a3af2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:48.225475 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-aaf406b5-e55b-42fb-9c09-956b8e7a3af2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:48.225475 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-aaf406b5-e55b-42fb-9c09-956b8e7a3af2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:48.272032 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4d6a7d83-7b74-4f01-b54f-591b873d6097 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:48.272690 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4d6a7d83-7b74-4f01-b54f-591b873d6097 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:48.291319 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4d6a7d83-7b74-4f01-b54f-591b873d6097 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:48.291825 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4d6a7d83-7b74-4f01-b54f-591b873d6097 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:48.292273 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4d6a7d83-7b74-4f01-b54f-591b873d6097 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:48.292994 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4d6a7d83-7b74-4f01-b54f-591b873d6097 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:48.293456 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4d6a7d83-7b74-4f01-b54f-591b873d6097 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:48.294001 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4d6a7d83-7b74-4f01-b54f-591b873d6097 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:48.297142 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-aaf406b5-e55b-42fb-9c09-956b8e7a3af2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:48.319828 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-aaf406b5-e55b-42fb-9c09-956b8e7a3af2 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1241 microversion: 2.1 time: 0.111269 Aug 24 17:52:48.341984 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 259/517] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:48 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1241 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:48.388069 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-5a2087ea-99ef-4bb1-a148-b2603eff4a12 req-e156d99f-2590-4625-9ec0-374ec84be21f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89e452a-4645-4263-acfb-2d195ceb949d", "name": "network-vif-plugged", "status": "completed", "tag": "a32d788d-e627-4b4e-98c7-b11b1d170329"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:48.401120 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-5a2087ea-99ef-4bb1-a148-b2603eff4a12 req-e156d99f-2590-4625-9ec0-374ec84be21f service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:48.402108 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-5a2087ea-99ef-4bb1-a148-b2603eff4a12 req-e156d99f-2590-4625-9ec0-374ec84be21f service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:48.402722 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-5a2087ea-99ef-4bb1-a148-b2603eff4a12 req-e156d99f-2590-4625-9ec0-374ec84be21f service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:48.420617 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-5a2087ea-99ef-4bb1-a148-b2603eff4a12 req-e156d99f-2590-4625-9ec0-374ec84be21f service nova] Creating event network-vif-plugged:a32d788d-e627-4b4e-98c7-b11b1d170329 for instance a89e452a-4645-4263-acfb-2d195ceb949d on hv-cinder-85442 Aug 24 17:52:48.429567 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-5a2087ea-99ef-4bb1-a148-b2603eff4a12 req-e156d99f-2590-4625-9ec0-374ec84be21f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045651 Aug 24 17:52:48.436062 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 260/518] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:52:48.587256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d65e4c53-b69c-43a8-b328-b39e5ab56ada tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:48.588599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d65e4c53-b69c-43a8-b328-b39e5ab56ada tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:48.595577 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d65e4c53-b69c-43a8-b328-b39e5ab56ada tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:48.596113 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d65e4c53-b69c-43a8-b328-b39e5ab56ada tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:48.596556 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d65e4c53-b69c-43a8-b328-b39e5ab56ada tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:48.597444 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d65e4c53-b69c-43a8-b328-b39e5ab56ada tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:48.597971 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d65e4c53-b69c-43a8-b328-b39e5ab56ada tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:48.598456 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d65e4c53-b69c-43a8-b328-b39e5ab56ada tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:48.814936 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d65e4c53-b69c-43a8-b328-b39e5ab56ada tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:48.823898 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d65e4c53-b69c-43a8-b328-b39e5ab56ada tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1211 microversion: 2.1 time: 0.241761 Aug 24 17:52:48.824616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 261/519] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:48 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1211 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:48.878536 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-4d6a7d83-7b74-4f01-b54f-591b873d6097 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:48.890869 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-4d6a7d83-7b74-4f01-b54f-591b873d6097 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1314 microversion: 2.1 time: 0.622468 Aug 24 17:52:48.890869 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 259/520] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:48 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:49.058254 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-50e18651-e034-488a-bd26-53e17cccb677 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:49.060262 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-50e18651-e034-488a-bd26-53e17cccb677 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:49.065670 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-50e18651-e034-488a-bd26-53e17cccb677 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:49.066289 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-50e18651-e034-488a-bd26-53e17cccb677 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:49.066796 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-50e18651-e034-488a-bd26-53e17cccb677 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:49.067604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-50e18651-e034-488a-bd26-53e17cccb677 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:49.068135 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-50e18651-e034-488a-bd26-53e17cccb677 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:49.068700 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-50e18651-e034-488a-bd26-53e17cccb677 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:49.345626 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e21c3c21-d9b9-4b98-81b3-e53e3f435d8e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:49.346530 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-e21c3c21-d9b9-4b98-81b3-e53e3f435d8e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:49.349652 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=2 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:49.353630 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-50e18651-e034-488a-bd26-53e17cccb677 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:49.367705 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e21c3c21-d9b9-4b98-81b3-e53e3f435d8e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:49.369313 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e21c3c21-d9b9-4b98-81b3-e53e3f435d8e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:49.372144 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-50e18651-e034-488a-bd26-53e17cccb677 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1681 microversion: 2.1 time: 0.318520 Aug 24 17:52:49.372926 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e21c3c21-d9b9-4b98-81b3-e53e3f435d8e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:49.374171 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e21c3c21-d9b9-4b98-81b3-e53e3f435d8e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:49.374791 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e21c3c21-d9b9-4b98-81b3-e53e3f435d8e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:49.375370 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e21c3c21-d9b9-4b98-81b3-e53e3f435d8e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:49.376140 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 262/521] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:49 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1681 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:49.512445 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e21c3c21-d9b9-4b98-81b3-e53e3f435d8e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:49.521314 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-e21c3c21-d9b9-4b98-81b3-e53e3f435d8e tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1305 microversion: 2.1 time: 0.182387 Aug 24 17:52:49.522323 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 260/522] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:49 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1305 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:49.848438 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f33b0cdc-d71f-4c3f-8c0c-849a046e6771 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:49.849838 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f33b0cdc-d71f-4c3f-8c0c-849a046e6771 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:49.851918 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=10 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:49.857601 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f33b0cdc-d71f-4c3f-8c0c-849a046e6771 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:49.858122 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f33b0cdc-d71f-4c3f-8c0c-849a046e6771 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:49.858565 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f33b0cdc-d71f-4c3f-8c0c-849a046e6771 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:49.859270 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f33b0cdc-d71f-4c3f-8c0c-849a046e6771 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:49.859945 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f33b0cdc-d71f-4c3f-8c0c-849a046e6771 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:49.860371 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f33b0cdc-d71f-4c3f-8c0c-849a046e6771 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:49.911125 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-45ec3cb4-cd3b-4e05-8a69-cea0213158e3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:49.911916 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-45ec3cb4-cd3b-4e05-8a69-cea0213158e3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:49.923807 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45ec3cb4-cd3b-4e05-8a69-cea0213158e3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:49.923807 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45ec3cb4-cd3b-4e05-8a69-cea0213158e3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:49.923807 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45ec3cb4-cd3b-4e05-8a69-cea0213158e3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:49.923807 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45ec3cb4-cd3b-4e05-8a69-cea0213158e3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:49.924162 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45ec3cb4-cd3b-4e05-8a69-cea0213158e3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:49.924162 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-45ec3cb4-cd3b-4e05-8a69-cea0213158e3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:50.212329 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f33b0cdc-d71f-4c3f-8c0c-849a046e6771 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:50.230857 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f33b0cdc-d71f-4c3f-8c0c-849a046e6771 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1279 microversion: 2.1 time: 0.389397 Aug 24 17:52:50.240641 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 263/523] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:49 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1279 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:50.288990 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-45ec3cb4-cd3b-4e05-8a69-cea0213158e3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:50.302307 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-45ec3cb4-cd3b-4e05-8a69-cea0213158e3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1314 microversion: 2.1 time: 0.395370 Aug 24 17:52:50.304182 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 261/524] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:49 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:50.398920 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d17993ab-3c1d-4f4c-8e90-8ad6417ff73c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:50.400650 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d17993ab-3c1d-4f4c-8e90-8ad6417ff73c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:50.407644 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d17993ab-3c1d-4f4c-8e90-8ad6417ff73c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:50.408671 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d17993ab-3c1d-4f4c-8e90-8ad6417ff73c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:50.409303 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d17993ab-3c1d-4f4c-8e90-8ad6417ff73c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:50.410210 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d17993ab-3c1d-4f4c-8e90-8ad6417ff73c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:50.410829 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d17993ab-3c1d-4f4c-8e90-8ad6417ff73c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:50.411259 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d17993ab-3c1d-4f4c-8e90-8ad6417ff73c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:50.544425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-582e6e1c-ba91-4547-8a44-709aa52264f5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:50.545345 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-582e6e1c-ba91-4547-8a44-709aa52264f5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:50.552696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=14 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:50.562440 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-582e6e1c-ba91-4547-8a44-709aa52264f5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:50.562440 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-582e6e1c-ba91-4547-8a44-709aa52264f5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:50.562697 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d17993ab-3c1d-4f4c-8e90-8ad6417ff73c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:50.562816 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-582e6e1c-ba91-4547-8a44-709aa52264f5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:50.568751 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-582e6e1c-ba91-4547-8a44-709aa52264f5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:50.569361 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-582e6e1c-ba91-4547-8a44-709aa52264f5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:50.573899 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-582e6e1c-ba91-4547-8a44-709aa52264f5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:50.579445 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d17993ab-3c1d-4f4c-8e90-8ad6417ff73c tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1614 microversion: 2.1 time: 0.185059 Aug 24 17:52:50.580770 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 264/525] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:50 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1614 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:50.585875 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-e653d261-7283-46ef-8fe0-b858cfcfea94 req-09a671e7-bf93-4f71-a8b9-22b34ae06f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e96b5e63-7140-4b8b-99e9-005627134785", "name": "network-vif-deleted", "tag": "7f2abfe3-e47f-4067-a51b-0d1eceadb9db"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:50.597672 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-e653d261-7283-46ef-8fe0-b858cfcfea94 req-09a671e7-bf93-4f71-a8b9-22b34ae06f31 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:50.598467 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-e653d261-7283-46ef-8fe0-b858cfcfea94 req-09a671e7-bf93-4f71-a8b9-22b34ae06f31 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:50.599120 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-e653d261-7283-46ef-8fe0-b858cfcfea94 req-09a671e7-bf93-4f71-a8b9-22b34ae06f31 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:50.616185 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-e653d261-7283-46ef-8fe0-b858cfcfea94 req-09a671e7-bf93-4f71-a8b9-22b34ae06f31 service nova] Creating event network-vif-deleted:7f2abfe3-e47f-4067-a51b-0d1eceadb9db for instance e96b5e63-7140-4b8b-99e9-005627134785 on hv-cinder-85442 Aug 24 17:52:50.626886 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-e653d261-7283-46ef-8fe0-b858cfcfea94 req-09a671e7-bf93-4f71-a8b9-22b34ae06f31 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043706 Aug 24 17:52:50.630852 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 265/526] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:52:50.677363 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-582e6e1c-ba91-4547-8a44-709aa52264f5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:50.686199 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-582e6e1c-ba91-4547-8a44-709aa52264f5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1303 microversion: 2.1 time: 0.146281 Aug 24 17:52:50.699050 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 262/527] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:50 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1303 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:51.300192 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b07ea1a9-a867-485b-a32b-2ba78c96bff4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:51.300192 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-b07ea1a9-a867-485b-a32b-2ba78c96bff4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:51.300192 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b07ea1a9-a867-485b-a32b-2ba78c96bff4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:51.300192 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b07ea1a9-a867-485b-a32b-2ba78c96bff4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:51.300844 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b07ea1a9-a867-485b-a32b-2ba78c96bff4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:51.300844 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b07ea1a9-a867-485b-a32b-2ba78c96bff4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:51.300844 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b07ea1a9-a867-485b-a32b-2ba78c96bff4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:51.300844 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b07ea1a9-a867-485b-a32b-2ba78c96bff4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:51.326411 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-46b636fc-3762-4e04-a1e6-4c7ebbcfc490 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:51.327699 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-46b636fc-3762-4e04-a1e6-4c7ebbcfc490 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:51.335524 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46b636fc-3762-4e04-a1e6-4c7ebbcfc490 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:51.336278 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46b636fc-3762-4e04-a1e6-4c7ebbcfc490 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:51.336927 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46b636fc-3762-4e04-a1e6-4c7ebbcfc490 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:51.338372 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46b636fc-3762-4e04-a1e6-4c7ebbcfc490 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:51.340182 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46b636fc-3762-4e04-a1e6-4c7ebbcfc490 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:51.341206 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46b636fc-3762-4e04-a1e6-4c7ebbcfc490 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:51.530020 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b07ea1a9-a867-485b-a32b-2ba78c96bff4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:51.540089 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b07ea1a9-a867-485b-a32b-2ba78c96bff4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1279 microversion: 2.1 time: 0.288383 Aug 24 17:52:51.542059 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 266/528] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:51 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1279 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:51.598204 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-b81a01aa-7e5f-45ae-9a2f-50dca4217d8a req-48a85947-311e-44b6-a14a-87b128f4c1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829f4d8c-fcd5-4611-9878-af9c7b30e362", "tag": "7aa9edde-92b1-4e33-9fe7-371de05db5c9"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:51.615083 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-b81a01aa-7e5f-45ae-9a2f-50dca4217d8a req-48a85947-311e-44b6-a14a-87b128f4c1f7 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:51.616317 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-b81a01aa-7e5f-45ae-9a2f-50dca4217d8a req-48a85947-311e-44b6-a14a-87b128f4c1f7 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:51.617225 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-b81a01aa-7e5f-45ae-9a2f-50dca4217d8a req-48a85947-311e-44b6-a14a-87b128f4c1f7 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:51.631506 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-46b636fc-3762-4e04-a1e6-4c7ebbcfc490 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:51.634818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-b81a01aa-7e5f-45ae-9a2f-50dca4217d8a req-48a85947-311e-44b6-a14a-87b128f4c1f7 service nova] Creating event network-changed:7aa9edde-92b1-4e33-9fe7-371de05db5c9 for instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 on hv-cinder-85442 Aug 24 17:52:51.642169 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-46b636fc-3762-4e04-a1e6-4c7ebbcfc490 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1314 microversion: 2.1 time: 0.321526 Aug 24 17:52:51.643527 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 263/529] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:51 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:51.649430 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-27826413-648a-4706-9f92-bdbe6acef599 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:51.654986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-27826413-648a-4706-9f92-bdbe6acef599 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:51.658762 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-27826413-648a-4706-9f92-bdbe6acef599 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:51.659627 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-27826413-648a-4706-9f92-bdbe6acef599 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:51.660232 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-27826413-648a-4706-9f92-bdbe6acef599 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:51.661277 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-27826413-648a-4706-9f92-bdbe6acef599 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:51.662717 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-27826413-648a-4706-9f92-bdbe6acef599 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:51.663335 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-27826413-648a-4706-9f92-bdbe6acef599 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:51.667634 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-b81a01aa-7e5f-45ae-9a2f-50dca4217d8a req-48a85947-311e-44b6-a14a-87b128f4c1f7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071284 Aug 24 17:52:51.672245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 267/530] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:52:51.708806 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-27826413-648a-4706-9f92-bdbe6acef599 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:51.709874 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e1f1ba76-f4f9-4ff4-9988-4c5a865d8084 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:51.710034 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-27826413-648a-4706-9f92-bdbe6acef599 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:51.710479 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-27826413-648a-4706-9f92-bdbe6acef599 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:51.710634 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e1f1ba76-f4f9-4ff4-9988-4c5a865d8084 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:51.710995 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-27826413-648a-4706-9f92-bdbe6acef599 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lazy-loading 'fault' on Instance uuid e96b5e63-7140-4b8b-99e9-005627134785 {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:52:51.739738 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e1f1ba76-f4f9-4ff4-9988-4c5a865d8084 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:51.742575 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e1f1ba76-f4f9-4ff4-9988-4c5a865d8084 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:51.743788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e1f1ba76-f4f9-4ff4-9988-4c5a865d8084 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:51.748178 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e1f1ba76-f4f9-4ff4-9988-4c5a865d8084 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:51.750392 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e1f1ba76-f4f9-4ff4-9988-4c5a865d8084 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:51.754808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e1f1ba76-f4f9-4ff4-9988-4c5a865d8084 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:51.779569 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=100 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:51.782067 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-27826413-648a-4706-9f92-bdbe6acef599 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:51.796197 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-27826413-648a-4706-9f92-bdbe6acef599 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 200 len: 1331 microversion: 2.1 time: 0.151328 Aug 24 17:52:51.796775 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 264/531] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:51 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 1331 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:51.944300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e1f1ba76-f4f9-4ff4-9988-4c5a865d8084 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:51.952811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e1f1ba76-f4f9-4ff4-9988-4c5a865d8084 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1370 microversion: 2.1 time: 0.247121 Aug 24 17:52:51.953574 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 268/532] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:51 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1370 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:52.563158 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a84a6736-7968-4b86-991a-89a38af35ab3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:52.563692 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a84a6736-7968-4b86-991a-89a38af35ab3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:52.570490 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a84a6736-7968-4b86-991a-89a38af35ab3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:52.571229 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a84a6736-7968-4b86-991a-89a38af35ab3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:52.572138 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a84a6736-7968-4b86-991a-89a38af35ab3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:52.573121 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a84a6736-7968-4b86-991a-89a38af35ab3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:52.573556 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a84a6736-7968-4b86-991a-89a38af35ab3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:52.574081 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a84a6736-7968-4b86-991a-89a38af35ab3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:52.670290 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-1e36a053-7e84-4e04-9a8e-39c8c84ec195 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:52.670946 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-1e36a053-7e84-4e04-9a8e-39c8c84ec195 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:52.679404 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1e36a053-7e84-4e04-9a8e-39c8c84ec195 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:52.680204 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1e36a053-7e84-4e04-9a8e-39c8c84ec195 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:52.680824 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1e36a053-7e84-4e04-9a8e-39c8c84ec195 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:52.682433 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1e36a053-7e84-4e04-9a8e-39c8c84ec195 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:52.683244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1e36a053-7e84-4e04-9a8e-39c8c84ec195 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:52.683837 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1e36a053-7e84-4e04-9a8e-39c8c84ec195 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:52.757822 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a84a6736-7968-4b86-991a-89a38af35ab3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:52.768019 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a84a6736-7968-4b86-991a-89a38af35ab3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1267 microversion: 2.1 time: 0.208940 Aug 24 17:52:52.769102 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 265/533] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:52 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:52.826349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-94eaa456-5423-49e1-ae1d-c2b18014d503 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:52.827334 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-94eaa456-5423-49e1-ae1d-c2b18014d503 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:52.834326 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-94eaa456-5423-49e1-ae1d-c2b18014d503 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:52.835269 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-94eaa456-5423-49e1-ae1d-c2b18014d503 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:52.835881 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-94eaa456-5423-49e1-ae1d-c2b18014d503 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:52.836771 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-94eaa456-5423-49e1-ae1d-c2b18014d503 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:52.838681 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-94eaa456-5423-49e1-ae1d-c2b18014d503 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:52.839349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-94eaa456-5423-49e1-ae1d-c2b18014d503 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:52.855645 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-1e36a053-7e84-4e04-9a8e-39c8c84ec195 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:52.868393 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-1e36a053-7e84-4e04-9a8e-39c8c84ec195 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1499 microversion: 2.1 time: 0.202097 Aug 24 17:52:52.869720 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-94eaa456-5423-49e1-ae1d-c2b18014d503 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] HTTP exception thrown: Instance e96b5e63-7140-4b8b-99e9-005627134785 could not be found. Aug 24 17:52:52.870006 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 269/534] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:52 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1499 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-94eaa456-5423-49e1-ae1d-c2b18014d503 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Request method failure captured: Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 HTTP/1.1 Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmSbnOSGx7e91Bj6OLQvb6olH3rhtuwbwgCFF2TiEJuGnQyAMTLci2PNua_H1N1Jgo-7CaRuKelcRsW8AHd-7NBHe9Qv1DY7-HELa-jl_G34ACZrF6UPOZU70uNjUu-29pkZxRoJdko5GsGgd7qyf34-jqX4JFHPGtUaryYBDPnp0Vk Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:52:52.876249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:52:52.877639 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0a4d7fadea104c569ca29ff9be48089a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:52:52.877639 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:52:52.877639 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:52:52.877639 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:52:52.877639 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:52:52.877639 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:52:52.877639 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:52:52.877639 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: 251bc85f89774142a97acd77895b14e9 Aug 24 17:52:52.877639 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:52:52.877639 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:52:52.877639 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance e96b5e63-7140-4b8b-99e9-005627134785 could not be found. Aug 24 17:52:52.877639 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': 'e96b5e63-7140-4b8b-99e9-005627134785'} Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e96b5e63-7140-4b8b-99e9-005627134785 could not be found. Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:52:52.878422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:52:52.879688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:52:52.879688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:52:52.879688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:52:52.879688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:52:52.879688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:52:52.879688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:52:52.879688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:52:52.879688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e96b5e63-7140-4b8b-99e9-005627134785 could not be found. Aug 24 17:52:52.879688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:52:52.879688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:52:52.879688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:52:52.879688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:52.879688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:52:52.879688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:52:52.879688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:52:52.879688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:52:52.879688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e96b5e63-7140-4b8b-99e9-005627134785 could not be found. Aug 24 17:52:52.879688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:52:52.882093 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-94eaa456-5423-49e1-ae1d-c2b18014d503 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Returning 404 to user: Instance e96b5e63-7140-4b8b-99e9-005627134785 could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:52:52.882093 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-94eaa456-5423-49e1-ae1d-c2b18014d503 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 404 len: 111 microversion: 2.1 time: 0.058424 Aug 24 17:52:52.882093 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 266/535] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:52 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:52:52.896110 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-08441af4-e25e-465b-9170-47b785abebd5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '.version_select at 0x7fce77553160>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:52.976876 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-dc1dc440-1913-4337-875d-47826e3b97b7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:52.977495 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-dc1dc440-1913-4337-875d-47826e3b97b7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:52.987852 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dc1dc440-1913-4337-875d-47826e3b97b7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:52.987852 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dc1dc440-1913-4337-875d-47826e3b97b7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:52.987852 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dc1dc440-1913-4337-875d-47826e3b97b7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:52.987852 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dc1dc440-1913-4337-875d-47826e3b97b7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:52.989016 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dc1dc440-1913-4337-875d-47826e3b97b7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:52.989016 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dc1dc440-1913-4337-875d-47826e3b97b7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:53.022610 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-08441af4-e25e-465b-9170-47b785abebd5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-287417198" status: 202 len: 0 microversion: 2.1 time: 0.134011 Aug 24 17:52:53.022610 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 270/536] 10.222.0.76 () {58 vars in 1218 bytes} [Wed Aug 24 17:52:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-287417198 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:52:53.256213 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-dc1dc440-1913-4337-875d-47826e3b97b7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:53.264696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-dc1dc440-1913-4337-875d-47826e3b97b7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1370 microversion: 2.1 time: 0.291812 Aug 24 17:52:53.265646 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 267/537] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:52 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1370 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:53.514163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0e97acd4-652c-40a3-901c-3affa2d93b3c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:53.514735 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0e97acd4-652c-40a3-901c-3affa2d93b3c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:53.516769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:53.522801 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0e97acd4-652c-40a3-901c-3affa2d93b3c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:53.523630 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0e97acd4-652c-40a3-901c-3affa2d93b3c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:53.527007 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0e97acd4-652c-40a3-901c-3affa2d93b3c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:53.527007 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0e97acd4-652c-40a3-901c-3affa2d93b3c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:53.527007 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0e97acd4-652c-40a3-901c-3affa2d93b3c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:53.527007 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0e97acd4-652c-40a3-901c-3affa2d93b3c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:53.673297 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-0e97acd4-652c-40a3-901c-3affa2d93b3c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lazy-loading 'services' on Instance uuid 134fa9aa-ee04-40f4-807a-57429a1b55fd {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:52:53.718231 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-c5a4eec3-0e95-4be0-8f23-0677c22d06f3 req-e1cb9263-b0ad-41f7-8f2f-59900bec8749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d27bf857-8c45-4e91-b69c-a5ff394f502b", "tag": "6d25f4e4-bb42-4107-b7a2-69620f7c6955"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:53.730098 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-c5a4eec3-0e95-4be0-8f23-0677c22d06f3 req-e1cb9263-b0ad-41f7-8f2f-59900bec8749 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:53.730634 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-c5a4eec3-0e95-4be0-8f23-0677c22d06f3 req-e1cb9263-b0ad-41f7-8f2f-59900bec8749 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:53.731072 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-c5a4eec3-0e95-4be0-8f23-0677c22d06f3 req-e1cb9263-b0ad-41f7-8f2f-59900bec8749 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:53.746211 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-c5a4eec3-0e95-4be0-8f23-0677c22d06f3 req-e1cb9263-b0ad-41f7-8f2f-59900bec8749 service nova] Creating event network-changed:6d25f4e4-bb42-4107-b7a2-69620f7c6955 for instance d27bf857-8c45-4e91-b69c-a5ff394f502b on hv-cinder-85442 Aug 24 17:52:53.751607 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-c5a4eec3-0e95-4be0-8f23-0677c22d06f3 req-e1cb9263-b0ad-41f7-8f2f-59900bec8749 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040442 Aug 24 17:52:53.752415 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 268/538] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:52:53.793144 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-02173074-4b3c-4cea-a83a-0122dedb3b1d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:53.795632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-02173074-4b3c-4cea-a83a-0122dedb3b1d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:53.801278 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-02173074-4b3c-4cea-a83a-0122dedb3b1d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:53.801843 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-02173074-4b3c-4cea-a83a-0122dedb3b1d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:53.802485 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-02173074-4b3c-4cea-a83a-0122dedb3b1d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:53.803203 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-02173074-4b3c-4cea-a83a-0122dedb3b1d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:53.803765 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-02173074-4b3c-4cea-a83a-0122dedb3b1d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:53.804286 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-02173074-4b3c-4cea-a83a-0122dedb3b1d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:53.955810 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-02173074-4b3c-4cea-a83a-0122dedb3b1d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:53.964463 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-02173074-4b3c-4cea-a83a-0122dedb3b1d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1267 microversion: 2.1 time: 0.177221 Aug 24 17:52:53.965264 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 269/539] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:53 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:53.971136 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-67d60872-cb52-4735-9865-e0714a3f0885 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:53.971870 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-67d60872-cb52-4735-9865-e0714a3f0885 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:53.981263 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-67d60872-cb52-4735-9865-e0714a3f0885 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:53.982152 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-67d60872-cb52-4735-9865-e0714a3f0885 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:53.982480 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0e97acd4-652c-40a3-901c-3affa2d93b3c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "DELETE /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd/os-volume_attachments/a3c95cdc-2d5c-4649-96bc-0913c0fa9a82" status: 202 len: 0 microversion: 2.1 time: 0.472549 Aug 24 17:52:53.982835 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-67d60872-cb52-4735-9865-e0714a3f0885 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:53.983844 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 271/540] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 17:52:53 2022] DELETE /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd/os-volume_attachments/a3c95cdc-2d5c-4649-96bc-0913c0fa9a82 => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:52:53.984168 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-67d60872-cb52-4735-9865-e0714a3f0885 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:53.984793 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-67d60872-cb52-4735-9865-e0714a3f0885 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:53.985446 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-67d60872-cb52-4735-9865-e0714a3f0885 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:54.016657 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-67d60872-cb52-4735-9865-e0714a3f0885 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Going to try to terminate instance {{(pid=127677) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:52:54.287913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-9f8e95fb-32df-45e7-be32-662070dec84a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:54.288610 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-9f8e95fb-32df-45e7-be32-662070dec84a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:54.296026 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9f8e95fb-32df-45e7-be32-662070dec84a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:54.296581 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9f8e95fb-32df-45e7-be32-662070dec84a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:54.297036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9f8e95fb-32df-45e7-be32-662070dec84a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:54.297743 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9f8e95fb-32df-45e7-be32-662070dec84a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:54.298224 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9f8e95fb-32df-45e7-be32-662070dec84a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:54.303427 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9f8e95fb-32df-45e7-be32-662070dec84a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:54.323991 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-67d60872-cb52-4735-9865-e0714a3f0885 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 204 len: 0 microversion: 2.1 time: 0.357244 Aug 24 17:52:54.324578 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 270/541] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:52:53 2022] DELETE /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:52:54.333679 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1a7207c5-2d63-4e3d-aebe-ab60df97688b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:54.334515 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1a7207c5-2d63-4e3d-aebe-ab60df97688b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:54.342292 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1a7207c5-2d63-4e3d-aebe-ab60df97688b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:54.342929 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1a7207c5-2d63-4e3d-aebe-ab60df97688b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:54.343478 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1a7207c5-2d63-4e3d-aebe-ab60df97688b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:54.344296 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1a7207c5-2d63-4e3d-aebe-ab60df97688b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:54.344856 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1a7207c5-2d63-4e3d-aebe-ab60df97688b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:54.345583 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1a7207c5-2d63-4e3d-aebe-ab60df97688b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:54.367815 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:54.508878 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-9f8e95fb-32df-45e7-be32-662070dec84a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:54.519545 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-9f8e95fb-32df-45e7-be32-662070dec84a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1370 microversion: 2.1 time: 0.236179 Aug 24 17:52:54.520634 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 272/542] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:54 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:54.550279 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1a7207c5-2d63-4e3d-aebe-ab60df97688b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:54.563463 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1a7207c5-2d63-4e3d-aebe-ab60df97688b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1505 microversion: 2.1 time: 0.234200 Aug 24 17:52:54.564469 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 271/543] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:54 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1505 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:54.917468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-1c6390f4-e6d0-46d1-8c00-55d22d6f471d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:54.918039 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-1c6390f4-e6d0-46d1-8c00-55d22d6f471d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:54.933455 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c6390f4-e6d0-46d1-8c00-55d22d6f471d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:54.934026 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c6390f4-e6d0-46d1-8c00-55d22d6f471d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:54.934908 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c6390f4-e6d0-46d1-8c00-55d22d6f471d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:54.935161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c6390f4-e6d0-46d1-8c00-55d22d6f471d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:54.935618 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c6390f4-e6d0-46d1-8c00-55d22d6f471d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:54.936039 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c6390f4-e6d0-46d1-8c00-55d22d6f471d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:54.988857 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-92534675-bc0d-4c9a-8252-8c582080a4d5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:54.989471 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-92534675-bc0d-4c9a-8252-8c582080a4d5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:54.997931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-92534675-bc0d-4c9a-8252-8c582080a4d5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:54.998422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-92534675-bc0d-4c9a-8252-8c582080a4d5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:54.998858 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-92534675-bc0d-4c9a-8252-8c582080a4d5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:54.999552 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-92534675-bc0d-4c9a-8252-8c582080a4d5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:55.000003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-92534675-bc0d-4c9a-8252-8c582080a4d5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:55.000444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-92534675-bc0d-4c9a-8252-8c582080a4d5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:55.032451 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-1c6390f4-e6d0-46d1-8c00-55d22d6f471d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lazy-loading 'services' on Instance uuid 8cd743b2-3b6c-4213-819a-1a25314ed5e2 {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:52:55.160068 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-92534675-bc0d-4c9a-8252-8c582080a4d5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:55.169657 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-92534675-bc0d-4c9a-8252-8c582080a4d5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1267 microversion: 2.1 time: 0.186647 Aug 24 17:52:55.170847 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 272/544] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:54 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:55.248499 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-1c6390f4-e6d0-46d1-8c00-55d22d6f471d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "DELETE /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments/b267c041-ab30-43cd-9d46-5b63aab4e10d" status: 202 len: 0 microversion: 2.1 time: 0.336122 Aug 24 17:52:55.249100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 273/545] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 17:52:54 2022] DELETE /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments/b267c041-ab30-43cd-9d46-5b63aab4e10d => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:52:55.258453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a607f1ed-7c5b-427d-8869-e135358dbb49 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:55.261300 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a607f1ed-7c5b-427d-8869-e135358dbb49 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:55.267808 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a607f1ed-7c5b-427d-8869-e135358dbb49 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:55.268297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a607f1ed-7c5b-427d-8869-e135358dbb49 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:55.268732 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a607f1ed-7c5b-427d-8869-e135358dbb49 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:55.269434 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a607f1ed-7c5b-427d-8869-e135358dbb49 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:55.269923 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a607f1ed-7c5b-427d-8869-e135358dbb49 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:55.270361 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a607f1ed-7c5b-427d-8869-e135358dbb49 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:55.305186 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a607f1ed-7c5b-427d-8869-e135358dbb49 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051454 Aug 24 17:52:55.305808 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 273/546] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:52:55 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:52:55.542887 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8cd344ac-ba6a-4a12-af56-2e3e3f58dafa tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:55.543612 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8cd344ac-ba6a-4a12-af56-2e3e3f58dafa tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:55.550027 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8cd344ac-ba6a-4a12-af56-2e3e3f58dafa tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:55.550561 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8cd344ac-ba6a-4a12-af56-2e3e3f58dafa tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:55.551052 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8cd344ac-ba6a-4a12-af56-2e3e3f58dafa tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:55.551801 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8cd344ac-ba6a-4a12-af56-2e3e3f58dafa tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:55.552287 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8cd344ac-ba6a-4a12-af56-2e3e3f58dafa tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:55.552753 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8cd344ac-ba6a-4a12-af56-2e3e3f58dafa tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:55.594591 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3fad78c7-47df-4ed7-ad67-262c7fe8246d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:55.598285 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3fad78c7-47df-4ed7-ad67-262c7fe8246d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:55.601496 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3fad78c7-47df-4ed7-ad67-262c7fe8246d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:55.602033 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3fad78c7-47df-4ed7-ad67-262c7fe8246d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:55.602591 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3fad78c7-47df-4ed7-ad67-262c7fe8246d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:55.603249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3fad78c7-47df-4ed7-ad67-262c7fe8246d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:55.603704 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3fad78c7-47df-4ed7-ad67-262c7fe8246d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:55.604204 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3fad78c7-47df-4ed7-ad67-262c7fe8246d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:55.749408 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8cd344ac-ba6a-4a12-af56-2e3e3f58dafa tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:55.757750 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-8cd344ac-ba6a-4a12-af56-2e3e3f58dafa tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1370 microversion: 2.1 time: 0.219059 Aug 24 17:52:55.758380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 274/547] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:55 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1370 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:55.775686 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3fad78c7-47df-4ed7-ad67-262c7fe8246d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:55.783592 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3fad78c7-47df-4ed7-ad67-262c7fe8246d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1505 microversion: 2.1 time: 0.193212 Aug 24 17:52:55.784160 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 274/548] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:55 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:56.191016 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7cc4962d-6c87-47b0-ba78-50094ddff67c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:56.191683 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7cc4962d-6c87-47b0-ba78-50094ddff67c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:56.198531 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7cc4962d-6c87-47b0-ba78-50094ddff67c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:56.199156 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7cc4962d-6c87-47b0-ba78-50094ddff67c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:56.199508 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7cc4962d-6c87-47b0-ba78-50094ddff67c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:56.200220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7cc4962d-6c87-47b0-ba78-50094ddff67c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:56.200656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7cc4962d-6c87-47b0-ba78-50094ddff67c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:56.201088 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7cc4962d-6c87-47b0-ba78-50094ddff67c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:56.318398 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1abad13c-3de6-4850-9dad-4b2b2f796874 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:56.320747 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1abad13c-3de6-4850-9dad-4b2b2f796874 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:56.327526 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1abad13c-3de6-4850-9dad-4b2b2f796874 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:56.329554 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1abad13c-3de6-4850-9dad-4b2b2f796874 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:56.329554 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1abad13c-3de6-4850-9dad-4b2b2f796874 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:56.329554 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1abad13c-3de6-4850-9dad-4b2b2f796874 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:56.329936 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1abad13c-3de6-4850-9dad-4b2b2f796874 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:56.330103 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1abad13c-3de6-4850-9dad-4b2b2f796874 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:56.356959 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7cc4962d-6c87-47b0-ba78-50094ddff67c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:56.365356 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7cc4962d-6c87-47b0-ba78-50094ddff67c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1267 microversion: 2.1 time: 0.178233 Aug 24 17:52:56.366198 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1abad13c-3de6-4850-9dad-4b2b2f796874 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053023 Aug 24 17:52:56.371153 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 275/549] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:52:56 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:52:56.375601 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 275/550] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:56 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:56.779931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d30024fd-869e-4ceb-aadb-44708c793b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:56.780540 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d30024fd-869e-4ceb-aadb-44708c793b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:56.786652 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d30024fd-869e-4ceb-aadb-44708c793b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:56.787138 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d30024fd-869e-4ceb-aadb-44708c793b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:56.787580 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d30024fd-869e-4ceb-aadb-44708c793b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:56.788303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d30024fd-869e-4ceb-aadb-44708c793b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:56.788763 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d30024fd-869e-4ceb-aadb-44708c793b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:56.789191 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d30024fd-869e-4ceb-aadb-44708c793b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:56.804565 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ed3ac024-0b07-4df5-9206-8a820c24a67d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:56.805130 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-ed3ac024-0b07-4df5-9206-8a820c24a67d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:56.811577 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ed3ac024-0b07-4df5-9206-8a820c24a67d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:56.812012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ed3ac024-0b07-4df5-9206-8a820c24a67d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:56.812449 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ed3ac024-0b07-4df5-9206-8a820c24a67d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:56.813148 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ed3ac024-0b07-4df5-9206-8a820c24a67d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:56.813648 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ed3ac024-0b07-4df5-9206-8a820c24a67d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:56.814124 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ed3ac024-0b07-4df5-9206-8a820c24a67d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:56.998300 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d30024fd-869e-4ceb-aadb-44708c793b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:57.003224 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-ed3ac024-0b07-4df5-9206-8a820c24a67d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:57.006868 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d30024fd-869e-4ceb-aadb-44708c793b62 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1370 microversion: 2.1 time: 0.231168 Aug 24 17:52:57.007346 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 276/551] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:56 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:57.011686 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-ed3ac024-0b07-4df5-9206-8a820c24a67d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1505 microversion: 2.1 time: 0.210960 Aug 24 17:52:57.012280 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 276/552] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:56 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1505 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:57.276777 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1bbd03d6-c51d-49e6-abc6-3bd4c12e48a8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:57.277365 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1bbd03d6-c51d-49e6-abc6-3bd4c12e48a8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:57.284215 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1bbd03d6-c51d-49e6-abc6-3bd4c12e48a8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:57.284696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1bbd03d6-c51d-49e6-abc6-3bd4c12e48a8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:57.285134 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1bbd03d6-c51d-49e6-abc6-3bd4c12e48a8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:57.285831 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1bbd03d6-c51d-49e6-abc6-3bd4c12e48a8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:57.286312 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1bbd03d6-c51d-49e6-abc6-3bd4c12e48a8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:57.286734 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1bbd03d6-c51d-49e6-abc6-3bd4c12e48a8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:57.315234 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1bbd03d6-c51d-49e6-abc6-3bd4c12e48a8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Going to try to terminate instance {{(pid=127677) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:52:57.378424 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-4f55bbde-f2d3-454d-9cbf-b7d0af77401b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:57.380710 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4f55bbde-f2d3-454d-9cbf-b7d0af77401b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:57.389238 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4f55bbde-f2d3-454d-9cbf-b7d0af77401b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:57.389881 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4f55bbde-f2d3-454d-9cbf-b7d0af77401b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:57.390424 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4f55bbde-f2d3-454d-9cbf-b7d0af77401b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:57.391255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4f55bbde-f2d3-454d-9cbf-b7d0af77401b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:57.391842 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4f55bbde-f2d3-454d-9cbf-b7d0af77401b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:57.392367 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4f55bbde-f2d3-454d-9cbf-b7d0af77401b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:57.424977 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-4f55bbde-f2d3-454d-9cbf-b7d0af77401b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050618 Aug 24 17:52:57.425544 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 277/553] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:52:57 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:52:57.430054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-355268d6-9d2e-4a7c-b0b8-0ed558f26415 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:57.430663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-355268d6-9d2e-4a7c-b0b8-0ed558f26415 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:57.437476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-355268d6-9d2e-4a7c-b0b8-0ed558f26415 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:57.438007 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-355268d6-9d2e-4a7c-b0b8-0ed558f26415 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:57.438450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-355268d6-9d2e-4a7c-b0b8-0ed558f26415 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:57.439155 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-355268d6-9d2e-4a7c-b0b8-0ed558f26415 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:57.439613 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-355268d6-9d2e-4a7c-b0b8-0ed558f26415 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:57.440038 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-355268d6-9d2e-4a7c-b0b8-0ed558f26415 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:57.591379 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-355268d6-9d2e-4a7c-b0b8-0ed558f26415 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:57.599382 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-355268d6-9d2e-4a7c-b0b8-0ed558f26415 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1267 microversion: 2.1 time: 0.172812 Aug 24 17:52:57.599949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 278/554] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:57 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:57.684230 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1bbd03d6-c51d-49e6-abc6-3bd4c12e48a8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "DELETE /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 204 len: 0 microversion: 2.1 time: 0.411844 Aug 24 17:52:57.684810 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 277/555] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:52:57 2022] DELETE /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:52:57.692998 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-1c471156-224a-41ff-a8a9-a7b243112801 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:57.693620 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-1c471156-224a-41ff-a8a9-a7b243112801 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:57.699849 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c471156-224a-41ff-a8a9-a7b243112801 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:57.703301 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c471156-224a-41ff-a8a9-a7b243112801 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:57.703301 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c471156-224a-41ff-a8a9-a7b243112801 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:57.703301 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c471156-224a-41ff-a8a9-a7b243112801 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:57.703301 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c471156-224a-41ff-a8a9-a7b243112801 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:57.703668 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c471156-224a-41ff-a8a9-a7b243112801 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:57.842540 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-1c471156-224a-41ff-a8a9-a7b243112801 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:57.851265 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-1c471156-224a-41ff-a8a9-a7b243112801 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1559 microversion: 2.1 time: 0.162035 Aug 24 17:52:57.852461 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 279/556] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:57 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:58.035504 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f228d776-edfe-4d3e-865f-d765e4a79ccb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:58.035504 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-f228d776-edfe-4d3e-865f-d765e4a79ccb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:58.040918 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-026ef411-f721-42cd-ab83-f18f9be9fe2b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:58.041088 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f228d776-edfe-4d3e-865f-d765e4a79ccb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:58.041334 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f228d776-edfe-4d3e-865f-d765e4a79ccb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:58.042323 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-026ef411-f721-42cd-ab83-f18f9be9fe2b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:58.042628 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f228d776-edfe-4d3e-865f-d765e4a79ccb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:58.049796 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f228d776-edfe-4d3e-865f-d765e4a79ccb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:58.049796 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f228d776-edfe-4d3e-865f-d765e4a79ccb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:58.049796 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f228d776-edfe-4d3e-865f-d765e4a79ccb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:58.050167 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-026ef411-f721-42cd-ab83-f18f9be9fe2b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:58.050167 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-026ef411-f721-42cd-ab83-f18f9be9fe2b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:58.050167 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-026ef411-f721-42cd-ab83-f18f9be9fe2b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:58.050167 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-026ef411-f721-42cd-ab83-f18f9be9fe2b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:58.050492 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-026ef411-f721-42cd-ab83-f18f9be9fe2b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:58.050909 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-026ef411-f721-42cd-ab83-f18f9be9fe2b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:58.253144 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f228d776-edfe-4d3e-865f-d765e4a79ccb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:58.262349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-f228d776-edfe-4d3e-865f-d765e4a79ccb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1505 microversion: 2.1 time: 0.232288 Aug 24 17:52:58.263202 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 278/557] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:58 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1505 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:58.268457 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-974ce726-86b3-4f52-9801-17cfb1962f3c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:58.269099 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-974ce726-86b3-4f52-9801-17cfb1962f3c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:58.270208 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-026ef411-f721-42cd-ab83-f18f9be9fe2b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:58.283192 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-974ce726-86b3-4f52-9801-17cfb1962f3c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:58.283816 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-974ce726-86b3-4f52-9801-17cfb1962f3c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:58.284353 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-974ce726-86b3-4f52-9801-17cfb1962f3c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:58.285203 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-974ce726-86b3-4f52-9801-17cfb1962f3c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:58.285732 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-974ce726-86b3-4f52-9801-17cfb1962f3c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:58.286248 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-974ce726-86b3-4f52-9801-17cfb1962f3c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:58.289999 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-026ef411-f721-42cd-ab83-f18f9be9fe2b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1370 microversion: 2.1 time: 0.252799 Aug 24 17:52:58.292416 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 280/558] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:58 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1370 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:58.424895 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-974ce726-86b3-4f52-9801-17cfb1962f3c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lazy-loading 'services' on Instance uuid ec9a988c-b152-4e39-ad48-c2f7facd203f {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:52:58.438771 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-010e783b-4938-49c9-b5fe-d0c5abbcc6d5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:58.441029 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-010e783b-4938-49c9-b5fe-d0c5abbcc6d5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:58.447218 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-010e783b-4938-49c9-b5fe-d0c5abbcc6d5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:58.447731 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-010e783b-4938-49c9-b5fe-d0c5abbcc6d5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:58.448332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-010e783b-4938-49c9-b5fe-d0c5abbcc6d5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:58.449032 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-010e783b-4938-49c9-b5fe-d0c5abbcc6d5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:58.449491 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-010e783b-4938-49c9-b5fe-d0c5abbcc6d5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:58.450042 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-010e783b-4938-49c9-b5fe-d0c5abbcc6d5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:58.481220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-010e783b-4938-49c9-b5fe-d0c5abbcc6d5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046587 Aug 24 17:52:58.481846 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 281/559] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:52:58 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:52:58.620587 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-dd4602f5-434d-4c60-b536-8b2c982c2476 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:58.621207 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-dd4602f5-434d-4c60-b536-8b2c982c2476 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:58.627215 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-dd4602f5-434d-4c60-b536-8b2c982c2476 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:58.627697 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-dd4602f5-434d-4c60-b536-8b2c982c2476 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:58.628136 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-dd4602f5-434d-4c60-b536-8b2c982c2476 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:58.628822 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-dd4602f5-434d-4c60-b536-8b2c982c2476 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:58.629277 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-dd4602f5-434d-4c60-b536-8b2c982c2476 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:58.629700 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-dd4602f5-434d-4c60-b536-8b2c982c2476 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:58.699800 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-974ce726-86b3-4f52-9801-17cfb1962f3c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f/os-volume_attachments/e3299462-4a0a-4df4-a1f0-cf7c5a51e668" status: 202 len: 0 microversion: 2.1 time: 0.435270 Aug 24 17:52:58.700561 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 279/560] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 17:52:58 2022] DELETE /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f/os-volume_attachments/e3299462-4a0a-4df4-a1f0-cf7c5a51e668 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:52:58.770327 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-dd4602f5-434d-4c60-b536-8b2c982c2476 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:58.779211 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-dd4602f5-434d-4c60-b536-8b2c982c2476 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1267 microversion: 2.1 time: 0.162578 Aug 24 17:52:58.779772 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 282/561] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:58 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:58.877834 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d7d4f858-499a-45ef-82f4-4773456f72ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:58.879112 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d7d4f858-499a-45ef-82f4-4773456f72ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:58.890662 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d7d4f858-499a-45ef-82f4-4773456f72ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:58.891523 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d7d4f858-499a-45ef-82f4-4773456f72ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:58.892302 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d7d4f858-499a-45ef-82f4-4773456f72ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:58.893241 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d7d4f858-499a-45ef-82f4-4773456f72ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:58.893699 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d7d4f858-499a-45ef-82f4-4773456f72ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:58.894163 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d7d4f858-499a-45ef-82f4-4773456f72ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:59.040629 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d7d4f858-499a-45ef-82f4-4773456f72ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:59.049358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d7d4f858-499a-45ef-82f4-4773456f72ae tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1513 microversion: 2.1 time: 0.179832 Aug 24 17:52:59.050028 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 280/562] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:58 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:59.284774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-fb602323-3c0e-43ad-a3d5-a9bad5159611 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:59.285417 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-fb602323-3c0e-43ad-a3d5-a9bad5159611 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:59.292154 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fb602323-3c0e-43ad-a3d5-a9bad5159611 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:59.292647 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fb602323-3c0e-43ad-a3d5-a9bad5159611 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:59.293242 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fb602323-3c0e-43ad-a3d5-a9bad5159611 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:59.293971 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fb602323-3c0e-43ad-a3d5-a9bad5159611 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:59.294439 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fb602323-3c0e-43ad-a3d5-a9bad5159611 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:59.294860 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fb602323-3c0e-43ad-a3d5-a9bad5159611 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:59.312680 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-7b209faf-0afe-41ab-9364-626608dd78bc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:59.313288 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-7b209faf-0afe-41ab-9364-626608dd78bc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:59.319169 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7b209faf-0afe-41ab-9364-626608dd78bc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:59.319650 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7b209faf-0afe-41ab-9364-626608dd78bc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:59.320081 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7b209faf-0afe-41ab-9364-626608dd78bc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:59.320780 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7b209faf-0afe-41ab-9364-626608dd78bc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:59.321230 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7b209faf-0afe-41ab-9364-626608dd78bc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:59.321654 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7b209faf-0afe-41ab-9364-626608dd78bc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:59.513653 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-fb602323-3c0e-43ad-a3d5-a9bad5159611 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:59.525283 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7b209faf-0afe-41ab-9364-626608dd78bc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:59.527693 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-fb602323-3c0e-43ad-a3d5-a9bad5159611 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1505 microversion: 2.1 time: 0.246776 Aug 24 17:52:59.528473 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 283/563] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:59 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1505 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:59.534437 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-7b209faf-0afe-41ab-9364-626608dd78bc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1370 microversion: 2.1 time: 0.225525 Aug 24 17:52:59.535711 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 281/564] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:59 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:59.535910 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-99a7b004-a8af-4c7d-8ab6-04e3544951c6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:59.538392 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-99a7b004-a8af-4c7d-8ab6-04e3544951c6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:59.545756 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-99a7b004-a8af-4c7d-8ab6-04e3544951c6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:59.559386 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-99a7b004-a8af-4c7d-8ab6-04e3544951c6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:59.559386 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-99a7b004-a8af-4c7d-8ab6-04e3544951c6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:59.559386 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-99a7b004-a8af-4c7d-8ab6-04e3544951c6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:59.559386 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-99a7b004-a8af-4c7d-8ab6-04e3544951c6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:59.560035 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-99a7b004-a8af-4c7d-8ab6-04e3544951c6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:59.581875 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:59.588086 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-99a7b004-a8af-4c7d-8ab6-04e3544951c6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057863 Aug 24 17:52:59.593750 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 284/565] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:52:59 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:52:59.802810 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-025bab7d-898d-4e4f-ae16-9fd1ab897923 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:59.802810 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-025bab7d-898d-4e4f-ae16-9fd1ab897923 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:59.807982 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-025bab7d-898d-4e4f-ae16-9fd1ab897923 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:59.808651 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-025bab7d-898d-4e4f-ae16-9fd1ab897923 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:59.809188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-025bab7d-898d-4e4f-ae16-9fd1ab897923 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:59.810096 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-025bab7d-898d-4e4f-ae16-9fd1ab897923 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:59.810782 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-025bab7d-898d-4e4f-ae16-9fd1ab897923 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:59.810983 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-025bab7d-898d-4e4f-ae16-9fd1ab897923 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:59.982235 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-025bab7d-898d-4e4f-ae16-9fd1ab897923 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:59.990469 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-025bab7d-898d-4e4f-ae16-9fd1ab897923 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1267 microversion: 2.1 time: 0.193909 Aug 24 17:52:59.991061 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 282/566] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:59 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:00.072376 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5c1e4f52-5a4d-4086-8af3-97ed5fdcb017 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:00.073813 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5c1e4f52-5a4d-4086-8af3-97ed5fdcb017 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:00.086703 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5c1e4f52-5a4d-4086-8af3-97ed5fdcb017 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:00.093103 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5c1e4f52-5a4d-4086-8af3-97ed5fdcb017 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:00.093103 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5c1e4f52-5a4d-4086-8af3-97ed5fdcb017 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:00.093103 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5c1e4f52-5a4d-4086-8af3-97ed5fdcb017 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:00.093103 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5c1e4f52-5a4d-4086-8af3-97ed5fdcb017 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:00.093456 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5c1e4f52-5a4d-4086-8af3-97ed5fdcb017 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:00.263007 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5c1e4f52-5a4d-4086-8af3-97ed5fdcb017 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:00.270753 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5c1e4f52-5a4d-4086-8af3-97ed5fdcb017 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1513 microversion: 2.1 time: 0.202705 Aug 24 17:53:00.284496 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 285/567] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:00 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:00.490456 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-7eb53902-a3a0-414a-877e-21b9d28d96ed req-04fd861a-78a0-4888-adbe-f5624067145b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d27bf857-8c45-4e91-b69c-a5ff394f502b", "name": "network-vif-plugged", "status": "completed", "tag": "6d25f4e4-bb42-4107-b7a2-69620f7c6955"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:00.506340 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-7eb53902-a3a0-414a-877e-21b9d28d96ed req-04fd861a-78a0-4888-adbe-f5624067145b service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:00.506860 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-7eb53902-a3a0-414a-877e-21b9d28d96ed req-04fd861a-78a0-4888-adbe-f5624067145b service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:00.507303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-7eb53902-a3a0-414a-877e-21b9d28d96ed req-04fd861a-78a0-4888-adbe-f5624067145b service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:00.522281 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-7eb53902-a3a0-414a-877e-21b9d28d96ed req-04fd861a-78a0-4888-adbe-f5624067145b service nova] Creating event network-vif-plugged:6d25f4e4-bb42-4107-b7a2-69620f7c6955 for instance d27bf857-8c45-4e91-b69c-a5ff394f502b on hv-cinder-85442 Aug 24 17:53:00.528654 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-7eb53902-a3a0-414a-877e-21b9d28d96ed req-04fd861a-78a0-4888-adbe-f5624067145b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044171 Aug 24 17:53:00.529261 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 283/568] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:00.567776 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-323fb922-6ef8-4fc4-946a-9c964c39fdb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:00.568414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-323fb922-6ef8-4fc4-946a-9c964c39fdb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:00.575397 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-323fb922-6ef8-4fc4-946a-9c964c39fdb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:00.575962 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-323fb922-6ef8-4fc4-946a-9c964c39fdb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:00.576411 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-323fb922-6ef8-4fc4-946a-9c964c39fdb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:00.577122 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-323fb922-6ef8-4fc4-946a-9c964c39fdb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:00.577578 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-323fb922-6ef8-4fc4-946a-9c964c39fdb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:00.578075 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-323fb922-6ef8-4fc4-946a-9c964c39fdb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:00.584899 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ca3fa870-71f1-4695-844c-39f014d52d33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:00.586041 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ca3fa870-71f1-4695-844c-39f014d52d33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:00.595929 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ca3fa870-71f1-4695-844c-39f014d52d33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:00.596504 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ca3fa870-71f1-4695-844c-39f014d52d33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:00.597242 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ca3fa870-71f1-4695-844c-39f014d52d33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:00.598452 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ca3fa870-71f1-4695-844c-39f014d52d33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:00.599170 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ca3fa870-71f1-4695-844c-39f014d52d33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:00.599915 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ca3fa870-71f1-4695-844c-39f014d52d33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:00.759718 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-ca3fa870-71f1-4695-844c-39f014d52d33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:00.796374 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ca3fa870-71f1-4695-844c-39f014d52d33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1463 microversion: 2.1 time: 0.218657 Aug 24 17:53:00.801440 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 284/569] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:00 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1463 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:00.811042 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a0e1b218-8c58-48a8-a6e7-cc3b047d545e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:00.816076 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a0e1b218-8c58-48a8-a6e7-cc3b047d545e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:00.845298 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a0e1b218-8c58-48a8-a6e7-cc3b047d545e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:00.845298 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a0e1b218-8c58-48a8-a6e7-cc3b047d545e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:00.845298 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a0e1b218-8c58-48a8-a6e7-cc3b047d545e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:00.845298 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a0e1b218-8c58-48a8-a6e7-cc3b047d545e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:00.845602 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a0e1b218-8c58-48a8-a6e7-cc3b047d545e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:00.845602 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a0e1b218-8c58-48a8-a6e7-cc3b047d545e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:00.881469 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a0e1b218-8c58-48a8-a6e7-cc3b047d545e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077038 Aug 24 17:53:00.882471 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 285/570] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:53:00 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:00.887558 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-69720256-3169-45e3-b589-b66b2bb34e13 req-05b85b2d-13a0-413f-849d-fed8be2fa5af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89e452a-4645-4263-acfb-2d195ceb949d", "name": "network-vif-deleted", "tag": "a32d788d-e627-4b4e-98c7-b11b1d170329"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:00.898420 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-69720256-3169-45e3-b589-b66b2bb34e13 req-05b85b2d-13a0-413f-849d-fed8be2fa5af service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:00.899154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-69720256-3169-45e3-b589-b66b2bb34e13 req-05b85b2d-13a0-413f-849d-fed8be2fa5af service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:00.899584 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-69720256-3169-45e3-b589-b66b2bb34e13 req-05b85b2d-13a0-413f-849d-fed8be2fa5af service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:00.901971 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-323fb922-6ef8-4fc4-946a-9c964c39fdb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:00.913428 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-69720256-3169-45e3-b589-b66b2bb34e13 req-05b85b2d-13a0-413f-849d-fed8be2fa5af service nova] Creating event network-vif-deleted:a32d788d-e627-4b4e-98c7-b11b1d170329 for instance a89e452a-4645-4263-acfb-2d195ceb949d on hv-cinder-85442 Aug 24 17:53:00.917093 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-323fb922-6ef8-4fc4-946a-9c964c39fdb3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1370 microversion: 2.1 time: 0.352803 Aug 24 17:53:00.918564 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 286/571] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:00 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1370 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:00.923810 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-69720256-3169-45e3-b589-b66b2bb34e13 req-05b85b2d-13a0-413f-849d-fed8be2fa5af service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039446 Aug 24 17:53:00.925167 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 286/572] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:01.011827 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-031b7829-8525-4f29-b3a3-df5d8f69acfe tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:01.012471 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-031b7829-8525-4f29-b3a3-df5d8f69acfe tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:01.018740 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-031b7829-8525-4f29-b3a3-df5d8f69acfe tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:01.019230 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-031b7829-8525-4f29-b3a3-df5d8f69acfe tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:01.019665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-031b7829-8525-4f29-b3a3-df5d8f69acfe tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:01.020364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-031b7829-8525-4f29-b3a3-df5d8f69acfe tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:01.020816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-031b7829-8525-4f29-b3a3-df5d8f69acfe tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:01.021236 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-031b7829-8525-4f29-b3a3-df5d8f69acfe tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:01.187717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-031b7829-8525-4f29-b3a3-df5d8f69acfe tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:01.202806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-031b7829-8525-4f29-b3a3-df5d8f69acfe tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1267 microversion: 2.1 time: 0.192945 Aug 24 17:53:01.204500 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 287/573] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:01 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:01.312267 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-001c1ba3-df43-4576-b75f-63a72b95c555 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:01.313203 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-001c1ba3-df43-4576-b75f-63a72b95c555 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:01.320578 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-001c1ba3-df43-4576-b75f-63a72b95c555 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:01.321167 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-001c1ba3-df43-4576-b75f-63a72b95c555 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:01.321673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-001c1ba3-df43-4576-b75f-63a72b95c555 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:01.322499 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-001c1ba3-df43-4576-b75f-63a72b95c555 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:01.323778 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-001c1ba3-df43-4576-b75f-63a72b95c555 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:01.324521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-001c1ba3-df43-4576-b75f-63a72b95c555 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:01.329330 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:01.469841 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-001c1ba3-df43-4576-b75f-63a72b95c555 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:01.477973 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-001c1ba3-df43-4576-b75f-63a72b95c555 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1513 microversion: 2.1 time: 0.170423 Aug 24 17:53:01.478571 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 287/574] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:01 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:01.828228 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7a61a4ac-cb03-47d2-a707-c0a6e87d2a95 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:01.830571 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7a61a4ac-cb03-47d2-a707-c0a6e87d2a95 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:01.843492 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7a61a4ac-cb03-47d2-a707-c0a6e87d2a95 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:01.844834 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7a61a4ac-cb03-47d2-a707-c0a6e87d2a95 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:01.845634 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7a61a4ac-cb03-47d2-a707-c0a6e87d2a95 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:01.847151 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7a61a4ac-cb03-47d2-a707-c0a6e87d2a95 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:01.848267 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7a61a4ac-cb03-47d2-a707-c0a6e87d2a95 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:01.849242 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7a61a4ac-cb03-47d2-a707-c0a6e87d2a95 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:01.898205 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0972a4a9-8df6-4c00-be41-2e9c0cdee535 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:01.901801 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0972a4a9-8df6-4c00-be41-2e9c0cdee535 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:01.913190 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0972a4a9-8df6-4c00-be41-2e9c0cdee535 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:01.914350 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0972a4a9-8df6-4c00-be41-2e9c0cdee535 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:01.915132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0972a4a9-8df6-4c00-be41-2e9c0cdee535 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:01.917219 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0972a4a9-8df6-4c00-be41-2e9c0cdee535 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:01.918373 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0972a4a9-8df6-4c00-be41-2e9c0cdee535 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:01.919397 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0972a4a9-8df6-4c00-be41-2e9c0cdee535 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:01.922727 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7a61a4ac-cb03-47d2-a707-c0a6e87d2a95 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:01.923581 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7a61a4ac-cb03-47d2-a707-c0a6e87d2a95 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:01.924398 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7a61a4ac-cb03-47d2-a707-c0a6e87d2a95 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:01.925457 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-7a61a4ac-cb03-47d2-a707-c0a6e87d2a95 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lazy-loading 'fault' on Instance uuid a89e452a-4645-4263-acfb-2d195ceb949d {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:53:01.975801 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0972a4a9-8df6-4c00-be41-2e9c0cdee535 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083294 Aug 24 17:53:01.976380 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 288/575] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:53:01 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:01.987062 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-df5fda3d-9490-4f4b-bb9c-12689aab1af5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:01.987679 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-df5fda3d-9490-4f4b-bb9c-12689aab1af5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:01.995143 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-df5fda3d-9490-4f4b-bb9c-12689aab1af5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:01.996496 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-df5fda3d-9490-4f4b-bb9c-12689aab1af5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:01.997134 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-df5fda3d-9490-4f4b-bb9c-12689aab1af5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:01.998197 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-df5fda3d-9490-4f4b-bb9c-12689aab1af5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:01.998824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-df5fda3d-9490-4f4b-bb9c-12689aab1af5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:01.999442 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-df5fda3d-9490-4f4b-bb9c-12689aab1af5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:02.060934 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7a61a4ac-cb03-47d2-a707-c0a6e87d2a95 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:02.070082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7a61a4ac-cb03-47d2-a707-c0a6e87d2a95 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1304 microversion: 2.1 time: 0.250080 Aug 24 17:53:02.071633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 288/576] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:01 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1304 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:02.211577 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-df5fda3d-9490-4f4b-bb9c-12689aab1af5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:02.222555 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-df5fda3d-9490-4f4b-bb9c-12689aab1af5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1370 microversion: 2.1 time: 0.239592 Aug 24 17:53:02.223152 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 289/577] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:01 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:02.224530 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7907bc80-571a-4684-bb6a-639c3b26bae2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:02.225581 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7907bc80-571a-4684-bb6a-639c3b26bae2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:02.232683 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7907bc80-571a-4684-bb6a-639c3b26bae2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:02.233380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7907bc80-571a-4684-bb6a-639c3b26bae2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:02.233960 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7907bc80-571a-4684-bb6a-639c3b26bae2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:02.234554 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7907bc80-571a-4684-bb6a-639c3b26bae2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:02.235002 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7907bc80-571a-4684-bb6a-639c3b26bae2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:02.235420 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7907bc80-571a-4684-bb6a-639c3b26bae2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:02.504871 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f5362c98-22a2-473d-b5b3-20d040411ac8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:02.505747 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-f5362c98-22a2-473d-b5b3-20d040411ac8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:02.516827 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f5362c98-22a2-473d-b5b3-20d040411ac8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:02.517605 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f5362c98-22a2-473d-b5b3-20d040411ac8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:02.518351 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f5362c98-22a2-473d-b5b3-20d040411ac8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:02.519498 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f5362c98-22a2-473d-b5b3-20d040411ac8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:02.520245 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f5362c98-22a2-473d-b5b3-20d040411ac8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:02.520922 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f5362c98-22a2-473d-b5b3-20d040411ac8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:02.694253 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f5362c98-22a2-473d-b5b3-20d040411ac8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:02.704191 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-f5362c98-22a2-473d-b5b3-20d040411ac8 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1471 microversion: 2.1 time: 0.206104 Aug 24 17:53:02.705197 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 290/578] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:02 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1471 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:02.774629 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-9798b913-8ea4-4a3a-a218-d62e3ee932dd req-ebc1e5af-7159-4f19-91e4-e4f154352e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134fa9aa-ee04-40f4-807a-57429a1b55fd", "name": "network-vif-deleted", "tag": "4ef448d4-f3c6-4482-a435-e54d91528c44"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:02.784905 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-9798b913-8ea4-4a3a-a218-d62e3ee932dd req-ebc1e5af-7159-4f19-91e4-e4f154352e4c service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:02.785404 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-9798b913-8ea4-4a3a-a218-d62e3ee932dd req-ebc1e5af-7159-4f19-91e4-e4f154352e4c service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:02.785837 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-9798b913-8ea4-4a3a-a218-d62e3ee932dd req-ebc1e5af-7159-4f19-91e4-e4f154352e4c service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:02.798465 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-9798b913-8ea4-4a3a-a218-d62e3ee932dd req-ebc1e5af-7159-4f19-91e4-e4f154352e4c service nova] Creating event network-vif-deleted:4ef448d4-f3c6-4482-a435-e54d91528c44 for instance 134fa9aa-ee04-40f4-807a-57429a1b55fd on hv-cinder-85442 Aug 24 17:53:02.803604 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-9798b913-8ea4-4a3a-a218-d62e3ee932dd req-ebc1e5af-7159-4f19-91e4-e4f154352e4c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033283 Aug 24 17:53:02.804219 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 291/579] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:02.811390 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7907bc80-571a-4684-bb6a-639c3b26bae2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:02.819916 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7907bc80-571a-4684-bb6a-639c3b26bae2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1267 microversion: 2.1 time: 0.599094 Aug 24 17:53:02.820501 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 289/580] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:02 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1267 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:02.999070 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-050d4a33-1603-480e-b7f8-a41b2929d769 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:03.001673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-050d4a33-1603-480e-b7f8-a41b2929d769 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:03.008699 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-050d4a33-1603-480e-b7f8-a41b2929d769 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.009083 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-050d4a33-1603-480e-b7f8-a41b2929d769 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.009525 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-050d4a33-1603-480e-b7f8-a41b2929d769 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.010292 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-050d4a33-1603-480e-b7f8-a41b2929d769 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.010758 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-050d4a33-1603-480e-b7f8-a41b2929d769 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.011189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-050d4a33-1603-480e-b7f8-a41b2929d769 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.063291 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-050d4a33-1603-480e-b7f8-a41b2929d769 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076967 Aug 24 17:53:03.064334 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 292/581] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:53:02 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:53:03.098348 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a1c9362a-1570-40ac-9edc-37a37b7a5f7d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:03.099385 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a1c9362a-1570-40ac-9edc-37a37b7a5f7d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:03.115211 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a1c9362a-1570-40ac-9edc-37a37b7a5f7d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.122158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a1c9362a-1570-40ac-9edc-37a37b7a5f7d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.127246 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a1c9362a-1570-40ac-9edc-37a37b7a5f7d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.127246 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a1c9362a-1570-40ac-9edc-37a37b7a5f7d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.127246 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a1c9362a-1570-40ac-9edc-37a37b7a5f7d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.127246 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a1c9362a-1570-40ac-9edc-37a37b7a5f7d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.153802 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e2e215ab-eb13-4f1c-8802-ba8c623fcfbb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:03.154699 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-e2e215ab-eb13-4f1c-8802-ba8c623fcfbb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:03.168000 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e2e215ab-eb13-4f1c-8802-ba8c623fcfbb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.168887 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a1c9362a-1570-40ac-9edc-37a37b7a5f7d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.169005 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e2e215ab-eb13-4f1c-8802-ba8c623fcfbb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.169652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a1c9362a-1570-40ac-9edc-37a37b7a5f7d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.169759 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e2e215ab-eb13-4f1c-8802-ba8c623fcfbb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.170202 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a1c9362a-1570-40ac-9edc-37a37b7a5f7d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.170825 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-a1c9362a-1570-40ac-9edc-37a37b7a5f7d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lazy-loading 'fault' on Instance uuid a89e452a-4645-4263-acfb-2d195ceb949d {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:53:03.170957 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e2e215ab-eb13-4f1c-8802-ba8c623fcfbb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.171789 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e2e215ab-eb13-4f1c-8802-ba8c623fcfbb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.172553 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e2e215ab-eb13-4f1c-8802-ba8c623fcfbb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.205638 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-e2e215ab-eb13-4f1c-8802-ba8c623fcfbb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Going to try to terminate instance {{(pid=127677) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:53:03.222285 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a1c9362a-1570-40ac-9edc-37a37b7a5f7d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:03.238068 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a1c9362a-1570-40ac-9edc-37a37b7a5f7d tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1304 microversion: 2.1 time: 0.147978 Aug 24 17:53:03.240137 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 290/582] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:03 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:03.249017 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-74e1b309-71c6-43ce-8084-a1214db557cc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:03.250394 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-74e1b309-71c6-43ce-8084-a1214db557cc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:03.259500 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-74e1b309-71c6-43ce-8084-a1214db557cc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.260215 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-74e1b309-71c6-43ce-8084-a1214db557cc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.261146 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-74e1b309-71c6-43ce-8084-a1214db557cc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.262364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-74e1b309-71c6-43ce-8084-a1214db557cc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.263154 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-74e1b309-71c6-43ce-8084-a1214db557cc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.264164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-74e1b309-71c6-43ce-8084-a1214db557cc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.429402 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-74e1b309-71c6-43ce-8084-a1214db557cc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:03.437785 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-74e1b309-71c6-43ce-8084-a1214db557cc tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1370 microversion: 2.1 time: 0.195965 Aug 24 17:53:03.438432 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 291/583] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:03 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:03.559690 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-e2e215ab-eb13-4f1c-8802-ba8c623fcfbb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "DELETE /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 204 len: 0 microversion: 2.1 time: 0.413014 Aug 24 17:53:03.560654 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 293/584] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:53:03 2022] DELETE /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:53:03.572284 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-13a66142-15fd-4d6e-b72f-521c0cc984f5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:03.573792 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-13a66142-15fd-4d6e-b72f-521c0cc984f5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:03.584384 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-13a66142-15fd-4d6e-b72f-521c0cc984f5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.585186 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-13a66142-15fd-4d6e-b72f-521c0cc984f5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.586043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-13a66142-15fd-4d6e-b72f-521c0cc984f5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.587463 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-13a66142-15fd-4d6e-b72f-521c0cc984f5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.589406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-13a66142-15fd-4d6e-b72f-521c0cc984f5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.589406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-13a66142-15fd-4d6e-b72f-521c0cc984f5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.727501 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4b33cd8b-4948-44b7-9665-9b0c65e078d2 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:03.728489 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4b33cd8b-4948-44b7-9665-9b0c65e078d2 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:03.737188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4b33cd8b-4948-44b7-9665-9b0c65e078d2 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.737685 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4b33cd8b-4948-44b7-9665-9b0c65e078d2 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.738162 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4b33cd8b-4948-44b7-9665-9b0c65e078d2 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.738883 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4b33cd8b-4948-44b7-9665-9b0c65e078d2 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.739500 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4b33cd8b-4948-44b7-9665-9b0c65e078d2 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.739949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-13a66142-15fd-4d6e-b72f-521c0cc984f5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:03.740182 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4b33cd8b-4948-44b7-9665-9b0c65e078d2 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.751933 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-13a66142-15fd-4d6e-b72f-521c0cc984f5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1680 microversion: 2.1 time: 0.186867 Aug 24 17:53:03.757225 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 292/585] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:03 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:03.779619 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4b33cd8b-4948-44b7-9665-9b0c65e078d2 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.780259 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4b33cd8b-4948-44b7-9665-9b0c65e078d2 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.780705 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4b33cd8b-4948-44b7-9665-9b0c65e078d2 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.781173 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-4b33cd8b-4948-44b7-9665-9b0c65e078d2 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lazy-loading 'fault' on Instance uuid 134fa9aa-ee04-40f4-807a-57429a1b55fd {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:53:03.826684 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-4b33cd8b-4948-44b7-9665-9b0c65e078d2 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:03.835318 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-4b33cd8b-4948-44b7-9665-9b0c65e078d2 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1308 microversion: 2.1 time: 0.112371 Aug 24 17:53:03.835893 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 294/586] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:03 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1308 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:03.845339 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-26548b18-c114-420f-a786-bc6c806e306e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:03.846192 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-26548b18-c114-420f-a786-bc6c806e306e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:03.854440 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-26548b18-c114-420f-a786-bc6c806e306e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.855334 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-26548b18-c114-420f-a786-bc6c806e306e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.855870 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-26548b18-c114-420f-a786-bc6c806e306e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.856468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-26548b18-c114-420f-a786-bc6c806e306e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.856925 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-26548b18-c114-420f-a786-bc6c806e306e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.857343 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-26548b18-c114-420f-a786-bc6c806e306e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.009381 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-26548b18-c114-420f-a786-bc6c806e306e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:04.018885 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-26548b18-c114-420f-a786-bc6c806e306e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1267 microversion: 2.1 time: 0.178662 Aug 24 17:53:04.019476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 293/587] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:03 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:04.186881 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-484a4f4a-cac0-43d7-bb3e-98bc4bb139c2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:04.189447 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:04.194367 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-484a4f4a-cac0-43d7-bb3e-98bc4bb139c2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.194847 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-484a4f4a-cac0-43d7-bb3e-98bc4bb139c2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.195274 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-484a4f4a-cac0-43d7-bb3e-98bc4bb139c2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.224030 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-484a4f4a-cac0-43d7-bb3e-98bc4bb139c2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Going to try to stop instance {{(pid=127677) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 17:53:04.264086 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5629f7b5-3648-4f07-88af-34e2ed9c05a1 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:04.265841 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5629f7b5-3648-4f07-88af-34e2ed9c05a1 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:04.272602 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5629f7b5-3648-4f07-88af-34e2ed9c05a1 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.273360 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5629f7b5-3648-4f07-88af-34e2ed9c05a1 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.276249 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5629f7b5-3648-4f07-88af-34e2ed9c05a1 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.278214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5629f7b5-3648-4f07-88af-34e2ed9c05a1 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.281143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5629f7b5-3648-4f07-88af-34e2ed9c05a1 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.281937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5629f7b5-3648-4f07-88af-34e2ed9c05a1 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.340742 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5629f7b5-3648-4f07-88af-34e2ed9c05a1 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.341674 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5629f7b5-3648-4f07-88af-34e2ed9c05a1 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.342433 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5629f7b5-3648-4f07-88af-34e2ed9c05a1 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.343221 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-5629f7b5-3648-4f07-88af-34e2ed9c05a1 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lazy-loading 'fault' on Instance uuid a89e452a-4645-4263-acfb-2d195ceb949d {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:53:04.412673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-484a4f4a-cac0-43d7-bb3e-98bc4bb139c2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "POST /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f/action" status: 202 len: 0 microversion: 2.1 time: 0.229578 Aug 24 17:53:04.413831 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 295/588] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 17:53:04 2022] POST /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:53:04.414170 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5629f7b5-3648-4f07-88af-34e2ed9c05a1 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:04.427424 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d362adc8-6e57-412c-b0ac-b8c1ed4f2b59 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:04.429172 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d362adc8-6e57-412c-b0ac-b8c1ed4f2b59 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:04.430733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5629f7b5-3648-4f07-88af-34e2ed9c05a1 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1304 microversion: 2.1 time: 0.172368 Aug 24 17:53:04.431835 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 294/589] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:04 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1304 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:04.439315 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d362adc8-6e57-412c-b0ac-b8c1ed4f2b59 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.440550 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d362adc8-6e57-412c-b0ac-b8c1ed4f2b59 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.441471 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d362adc8-6e57-412c-b0ac-b8c1ed4f2b59 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.442453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d362adc8-6e57-412c-b0ac-b8c1ed4f2b59 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.443124 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d362adc8-6e57-412c-b0ac-b8c1ed4f2b59 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.443776 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d362adc8-6e57-412c-b0ac-b8c1ed4f2b59 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.468757 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-32a6ac43-d440-4dfd-9f67-74e7ce02e428 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:04.469918 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-32a6ac43-d440-4dfd-9f67-74e7ce02e428 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:04.481102 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-32a6ac43-d440-4dfd-9f67-74e7ce02e428 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.481983 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-32a6ac43-d440-4dfd-9f67-74e7ce02e428 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.486520 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-32a6ac43-d440-4dfd-9f67-74e7ce02e428 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.486520 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-32a6ac43-d440-4dfd-9f67-74e7ce02e428 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.486520 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-32a6ac43-d440-4dfd-9f67-74e7ce02e428 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.486520 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-32a6ac43-d440-4dfd-9f67-74e7ce02e428 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.680623 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d362adc8-6e57-412c-b0ac-b8c1ed4f2b59 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:04.692906 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d362adc8-6e57-412c-b0ac-b8c1ed4f2b59 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1722 microversion: 2.1 time: 0.272130 Aug 24 17:53:04.693658 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 296/590] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:04 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:04.720502 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-32a6ac43-d440-4dfd-9f67-74e7ce02e428 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:04.728769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-32a6ac43-d440-4dfd-9f67-74e7ce02e428 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1565 microversion: 2.1 time: 0.272241 Aug 24 17:53:04.729708 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 295/591] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:04 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1565 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:04.751000 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-533bc0a2-1c34-428d-966d-78c76ec34198 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:04.751496 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-533bc0a2-1c34-428d-966d-78c76ec34198 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:04.757453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-533bc0a2-1c34-428d-966d-78c76ec34198 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.757985 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-533bc0a2-1c34-428d-966d-78c76ec34198 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.758428 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-533bc0a2-1c34-428d-966d-78c76ec34198 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.759152 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-533bc0a2-1c34-428d-966d-78c76ec34198 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.759653 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-533bc0a2-1c34-428d-966d-78c76ec34198 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.760133 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-533bc0a2-1c34-428d-966d-78c76ec34198 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.772610 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0e8bffe2-defc-46fe-8e9c-391e72bbdcea tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:04.773281 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0e8bffe2-defc-46fe-8e9c-391e72bbdcea tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:04.781288 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0e8bffe2-defc-46fe-8e9c-391e72bbdcea tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.781787 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0e8bffe2-defc-46fe-8e9c-391e72bbdcea tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.782251 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0e8bffe2-defc-46fe-8e9c-391e72bbdcea tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.783181 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0e8bffe2-defc-46fe-8e9c-391e72bbdcea tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.784101 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0e8bffe2-defc-46fe-8e9c-391e72bbdcea tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.784535 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0e8bffe2-defc-46fe-8e9c-391e72bbdcea tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.863169 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-533bc0a2-1c34-428d-966d-78c76ec34198 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116123 Aug 24 17:53:04.865255 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 297/592] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 24 17:53:04 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:04.870242 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f63f145b-f362-4733-a432-393eb616fe4b tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:04.871020 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-f63f145b-f362-4733-a432-393eb616fe4b tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:04.877521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f63f145b-f362-4733-a432-393eb616fe4b tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.878219 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f63f145b-f362-4733-a432-393eb616fe4b tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.878663 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f63f145b-f362-4733-a432-393eb616fe4b tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.879367 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f63f145b-f362-4733-a432-393eb616fe4b tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.879821 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f63f145b-f362-4733-a432-393eb616fe4b tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.880243 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f63f145b-f362-4733-a432-393eb616fe4b tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.933064 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f63f145b-f362-4733-a432-393eb616fe4b tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.933603 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f63f145b-f362-4733-a432-393eb616fe4b tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.934083 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f63f145b-f362-4733-a432-393eb616fe4b tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.934544 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-f63f145b-f362-4733-a432-393eb616fe4b tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lazy-loading 'fault' on Instance uuid 134fa9aa-ee04-40f4-807a-57429a1b55fd {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:53:04.998454 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0e8bffe2-defc-46fe-8e9c-391e72bbdcea tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:05.001070 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f63f145b-f362-4733-a432-393eb616fe4b tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:05.007830 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0e8bffe2-defc-46fe-8e9c-391e72bbdcea tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1680 microversion: 2.1 time: 0.239000 Aug 24 17:53:05.009019 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 296/593] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:04 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1680 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:05.014047 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-f63f145b-f362-4733-a432-393eb616fe4b tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1308 microversion: 2.1 time: 0.147603 Aug 24 17:53:05.014913 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 298/594] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:04 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1308 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:05.044393 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-bc29bfda-687b-4a17-8b95-56c135480886 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:05.045536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-bc29bfda-687b-4a17-8b95-56c135480886 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:05.055769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bc29bfda-687b-4a17-8b95-56c135480886 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:05.056397 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bc29bfda-687b-4a17-8b95-56c135480886 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:05.056960 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bc29bfda-687b-4a17-8b95-56c135480886 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:05.058573 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bc29bfda-687b-4a17-8b95-56c135480886 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:05.059191 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bc29bfda-687b-4a17-8b95-56c135480886 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:05.059771 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bc29bfda-687b-4a17-8b95-56c135480886 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:05.236334 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-bc29bfda-687b-4a17-8b95-56c135480886 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:05.245369 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-bc29bfda-687b-4a17-8b95-56c135480886 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1267 microversion: 2.1 time: 0.208870 Aug 24 17:53:05.245997 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 297/595] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:05 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:05.470658 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-947d605c-c410-4fac-9f0f-c06613c8175f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:05.471586 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-947d605c-c410-4fac-9f0f-c06613c8175f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:05.478069 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-947d605c-c410-4fac-9f0f-c06613c8175f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:05.478562 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-947d605c-c410-4fac-9f0f-c06613c8175f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:05.479771 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-947d605c-c410-4fac-9f0f-c06613c8175f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:05.480874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-947d605c-c410-4fac-9f0f-c06613c8175f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:05.481497 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-947d605c-c410-4fac-9f0f-c06613c8175f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:05.482079 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-947d605c-c410-4fac-9f0f-c06613c8175f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:05.519142 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-947d605c-c410-4fac-9f0f-c06613c8175f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:05.519637 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-947d605c-c410-4fac-9f0f-c06613c8175f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:05.520083 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-947d605c-c410-4fac-9f0f-c06613c8175f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:05.520608 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-947d605c-c410-4fac-9f0f-c06613c8175f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lazy-loading 'fault' on Instance uuid a89e452a-4645-4263-acfb-2d195ceb949d {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:53:05.578861 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-947d605c-c410-4fac-9f0f-c06613c8175f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:05.581306 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-947d605c-c410-4fac-9f0f-c06613c8175f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 200 len: 1304 microversion: 2.1 time: 0.114647 Aug 24 17:53:05.582078 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 299/596] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:05 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:05.726183 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7c186fb8-13a4-4b83-a39c-43f408d535cb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:05.727072 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7c186fb8-13a4-4b83-a39c-43f408d535cb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:05.756523 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7c186fb8-13a4-4b83-a39c-43f408d535cb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:05.757938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7c186fb8-13a4-4b83-a39c-43f408d535cb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:05.758747 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7c186fb8-13a4-4b83-a39c-43f408d535cb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:05.762775 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7c186fb8-13a4-4b83-a39c-43f408d535cb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:05.766311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7c186fb8-13a4-4b83-a39c-43f408d535cb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:05.767468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7c186fb8-13a4-4b83-a39c-43f408d535cb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:05.966498 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7c186fb8-13a4-4b83-a39c-43f408d535cb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:05.977834 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7c186fb8-13a4-4b83-a39c-43f408d535cb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1676 microversion: 2.1 time: 0.264584 Aug 24 17:53:05.978463 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 298/597] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:05 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1676 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:06.038015 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-6a9bc129-401c-40db-9bff-e9f393d949b7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:06.039100 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-6a9bc129-401c-40db-9bff-e9f393d949b7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:06.039582 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7080360f-b980-40d3-9b20-8353669fcde1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:06.042242 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7080360f-b980-40d3-9b20-8353669fcde1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:06.047497 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7080360f-b980-40d3-9b20-8353669fcde1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:06.047989 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7080360f-b980-40d3-9b20-8353669fcde1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:06.048478 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7080360f-b980-40d3-9b20-8353669fcde1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:06.049186 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7080360f-b980-40d3-9b20-8353669fcde1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:06.049549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6a9bc129-401c-40db-9bff-e9f393d949b7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:06.050020 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7080360f-b980-40d3-9b20-8353669fcde1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:06.050212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7080360f-b980-40d3-9b20-8353669fcde1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:06.051211 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6a9bc129-401c-40db-9bff-e9f393d949b7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:06.051996 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6a9bc129-401c-40db-9bff-e9f393d949b7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:06.053627 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6a9bc129-401c-40db-9bff-e9f393d949b7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:06.054786 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6a9bc129-401c-40db-9bff-e9f393d949b7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:06.055844 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6a9bc129-401c-40db-9bff-e9f393d949b7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:06.085007 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7080360f-b980-40d3-9b20-8353669fcde1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:06.085600 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7080360f-b980-40d3-9b20-8353669fcde1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:06.086309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7080360f-b980-40d3-9b20-8353669fcde1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:06.086864 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-7080360f-b980-40d3-9b20-8353669fcde1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lazy-loading 'fault' on Instance uuid 134fa9aa-ee04-40f4-807a-57429a1b55fd {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:53:06.156020 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7080360f-b980-40d3-9b20-8353669fcde1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:06.167449 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7080360f-b980-40d3-9b20-8353669fcde1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 200 len: 1308 microversion: 2.1 time: 0.131536 Aug 24 17:53:06.168050 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 299/598] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:06 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 1308 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:06.274116 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-3fbda527-79f5-47d9-942d-db807121a41c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:06.276972 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-6a9bc129-401c-40db-9bff-e9f393d949b7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:06.278604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-3fbda527-79f5-47d9-942d-db807121a41c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:06.287572 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-6a9bc129-401c-40db-9bff-e9f393d949b7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1680 microversion: 2.1 time: 0.256670 Aug 24 17:53:06.288603 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 300/599] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:06 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1680 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:06.293361 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3fbda527-79f5-47d9-942d-db807121a41c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:06.294540 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3fbda527-79f5-47d9-942d-db807121a41c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:06.295698 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3fbda527-79f5-47d9-942d-db807121a41c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:06.296648 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3fbda527-79f5-47d9-942d-db807121a41c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:06.297732 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3fbda527-79f5-47d9-942d-db807121a41c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:06.298687 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3fbda527-79f5-47d9-942d-db807121a41c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:06.305012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=100 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:06.337692 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-461291fc-360c-4ef8-9f90-8d2ae3e842c7 req-99773521-bd59-49aa-82d7-306c84a4b1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d27bf857-8c45-4e91-b69c-a5ff394f502b", "tag": "6d25f4e4-bb42-4107-b7a2-69620f7c6955"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:06.352338 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-461291fc-360c-4ef8-9f90-8d2ae3e842c7 req-99773521-bd59-49aa-82d7-306c84a4b1d7 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:06.352995 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-461291fc-360c-4ef8-9f90-8d2ae3e842c7 req-99773521-bd59-49aa-82d7-306c84a4b1d7 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:06.353423 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-461291fc-360c-4ef8-9f90-8d2ae3e842c7 req-99773521-bd59-49aa-82d7-306c84a4b1d7 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:06.359532 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:06.368435 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-461291fc-360c-4ef8-9f90-8d2ae3e842c7 req-99773521-bd59-49aa-82d7-306c84a4b1d7 service nova] Creating event network-changed:6d25f4e4-bb42-4107-b7a2-69620f7c6955 for instance d27bf857-8c45-4e91-b69c-a5ff394f502b on hv-cinder-85442 Aug 24 17:53:06.378152 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-461291fc-360c-4ef8-9f90-8d2ae3e842c7 req-99773521-bd59-49aa-82d7-306c84a4b1d7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042030 Aug 24 17:53:06.380659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 301/600] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:06.611656 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c9675fd1-687e-49be-8281-259ffe354583 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:06.615125 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c9675fd1-687e-49be-8281-259ffe354583 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: a89e452a-4645-4263-acfb-2d195ceb949d] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:06.628193 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9675fd1-687e-49be-8281-259ffe354583 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:06.628193 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9675fd1-687e-49be-8281-259ffe354583 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:06.628961 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9675fd1-687e-49be-8281-259ffe354583 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:06.630129 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9675fd1-687e-49be-8281-259ffe354583 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:06.630811 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9675fd1-687e-49be-8281-259ffe354583 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:06.631504 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9675fd1-687e-49be-8281-259ffe354583 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:06.662914 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-c9675fd1-687e-49be-8281-259ffe354583 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] HTTP exception thrown: Instance a89e452a-4645-4263-acfb-2d195ceb949d could not be found. Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c9675fd1-687e-49be-8281-259ffe354583 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Request method failure captured: Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d HTTP/1.1 Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmVSfOJAxbbqGbJVkFRssVjdZz6GWKRJQwRBIMFOLp8V2ZUOdniItDKslKkzLh7B_jn5veiF-jrFsm5hjvCUekpqSYO_6-keYvXUsIgsuYKaVjtAtt5CGzKjffGl-IMmQxV6_YDUGkxEKOcam84p7u1mutffiXro1SR8mm-U3WWpJpI Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 6e895dd83dbf4458b7d6efaace0d209a Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-VolumesActionsTest-871884221 Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:53:06.664722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:53:06.666741 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/6e895dd83dbf4458b7d6efaace0d209a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6e895dd83dbf4458b7d6efaace0d209a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_6e895dd83dbf4458b7d6efaace0d209a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6e895dd83dbf4458b7d6efaace0d209a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:53:06.666741 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-VolumesActionsTest-871884221 Aug 24 17:53:06.666741 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 6e895dd83dbf4458b7d6efaace0d209a Aug 24 17:53:06.666741 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-VolumesActionsTest-871884221 Aug 24 17:53:06.666741 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-VolumesActionsTest-871884221-project Aug 24 17:53:06.666741 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:53:06.666741 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:53:06.666741 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: f08b2eba50904dda89fb743c9cf28958 Aug 24 17:53:06.666741 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-VolumesActionsTest-871884221-project Aug 24 17:53:06.666741 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:53:06.666741 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance a89e452a-4645-4263-acfb-2d195ceb949d could not be found. Aug 24 17:53:06.666741 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': 'a89e452a-4645-4263-acfb-2d195ceb949d'} Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89e452a-4645-4263-acfb-2d195ceb949d could not be found. Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:53:06.668140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:53:06.671960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:53:06.671960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:53:06.671960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:53:06.671960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:53:06.671960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:53:06.671960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:53:06.671960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:53:06.671960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89e452a-4645-4263-acfb-2d195ceb949d could not be found. Aug 24 17:53:06.671960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:53:06.671960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:53:06.671960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:53:06.671960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:06.671960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:53:06.671960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:53:06.671960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:53:06.671960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:53:06.671960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89e452a-4645-4263-acfb-2d195ceb949d could not be found. Aug 24 17:53:06.671960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:53:06.675065 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c9675fd1-687e-49be-8281-259ffe354583 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Returning 404 to user: Instance a89e452a-4645-4263-acfb-2d195ceb949d could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:53:06.675065 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c9675fd1-687e-49be-8281-259ffe354583 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d" status: 404 len: 111 microversion: 2.1 time: 0.060392 Aug 24 17:53:06.685006 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 302/601] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:06 2022] GET /compute/v2.1/servers/a89e452a-4645-4263-acfb-2d195ceb949d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:53:06.691295 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-da2f78a5-41bf-4493-81a9-34e62eeb83a5 req-89b68c9b-98ec-43d7-b4e6-d54defc656e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829f4d8c-fcd5-4611-9878-af9c7b30e362", "name": "network-vif-plugged", "status": "completed", "tag": "7aa9edde-92b1-4e33-9fe7-371de05db5c9"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:06.712413 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-da2f78a5-41bf-4493-81a9-34e62eeb83a5 req-89b68c9b-98ec-43d7-b4e6-d54defc656e1 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:06.712413 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-da2f78a5-41bf-4493-81a9-34e62eeb83a5 req-89b68c9b-98ec-43d7-b4e6-d54defc656e1 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:06.712796 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-da2f78a5-41bf-4493-81a9-34e62eeb83a5 req-89b68c9b-98ec-43d7-b4e6-d54defc656e1 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:06.745402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-da2f78a5-41bf-4493-81a9-34e62eeb83a5 req-89b68c9b-98ec-43d7-b4e6-d54defc656e1 service nova] Creating event network-vif-plugged:7aa9edde-92b1-4e33-9fe7-371de05db5c9 for instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 on hv-cinder-85442 Aug 24 17:53:06.752732 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-da2f78a5-41bf-4493-81a9-34e62eeb83a5 req-89b68c9b-98ec-43d7-b4e6-d54defc656e1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066152 Aug 24 17:53:06.754274 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 303/602] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:06.761130 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4673d118-3d9c-48f2-bb39-3f0fa1d93679 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1003737352", "imageRef": "2d76d745-abc6-4a7b-b8d7-46566b66934b", "flavorRef": "452", "networks": [{"uuid": "1fcff867-0bc4-4478-bdf7-0cc16094d8ae"}]}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:06.830386 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-3fbda527-79f5-47d9-942d-db807121a41c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:06.848164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-3fbda527-79f5-47d9-942d-db807121a41c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1267 microversion: 2.1 time: 0.582031 Aug 24 17:53:06.862143 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.network.neutron [None req-4673d118-3d9c-48f2-bb39-3f0fa1d93679 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] validate_networks() for [('1fcff867-0bc4-4478-bdf7-0cc16094d8ae', None, None, None, None, None)] {{(pid=127677) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:53:06.863032 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 300/603] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:06 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1267 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:07.002043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-4e2bc99d-939e-4e50-b936-461cdd2a1196 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:07.003100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4e2bc99d-939e-4e50-b936-461cdd2a1196 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:07.010229 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e2bc99d-939e-4e50-b936-461cdd2a1196 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:07.010857 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e2bc99d-939e-4e50-b936-461cdd2a1196 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:07.011399 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e2bc99d-939e-4e50-b936-461cdd2a1196 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:07.012232 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e2bc99d-939e-4e50-b936-461cdd2a1196 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:07.012938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e2bc99d-939e-4e50-b936-461cdd2a1196 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:07.013631 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e2bc99d-939e-4e50-b936-461cdd2a1196 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:07.429385 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-4e2bc99d-939e-4e50-b936-461cdd2a1196 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:07.440247 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-4e2bc99d-939e-4e50-b936-461cdd2a1196 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1676 microversion: 2.1 time: 0.441836 Aug 24 17:53:07.441073 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 301/604] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:06 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1676 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:07.449689 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ed837846-fc78-498f-838b-f6fc38503e18 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:07.450173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-ed837846-fc78-498f-838b-f6fc38503e18 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 134fa9aa-ee04-40f4-807a-57429a1b55fd] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:07.458749 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ed837846-fc78-498f-838b-f6fc38503e18 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:07.459482 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ed837846-fc78-498f-838b-f6fc38503e18 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:07.459999 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ed837846-fc78-498f-838b-f6fc38503e18 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:07.461070 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ed837846-fc78-498f-838b-f6fc38503e18 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:07.461843 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ed837846-fc78-498f-838b-f6fc38503e18 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:07.462354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ed837846-fc78-498f-838b-f6fc38503e18 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:07.484993 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-ed837846-fc78-498f-838b-f6fc38503e18 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] HTTP exception thrown: Instance 134fa9aa-ee04-40f4-807a-57429a1b55fd could not be found. Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ed837846-fc78-498f-838b-f6fc38503e18 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Request method failure captured: Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd HTTP/1.1 Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmUgVAAMfG-TwMRCZqm69P8UbJ8WXUkGlT6Vhulm-Ql_Lqqu1BR4kups93f61yYEn0h29xSU7hSAJeK4gLFE-Fzq3ZEYcj_bZVEll9w_OANHfN-g3Y8nRNGuAQdGk8-wBkqwLH7dUAIVon7804zalDxcIFSCj4MbDRlx9YVnzCRYE9s Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 4fa9fd072c704af2950a9bb4339d374d Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1554740344 Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:53:07.487354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:53:07.489296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4fa9fd072c704af2950a9bb4339d374d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4fa9fd072c704af2950a9bb4339d374d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4fa9fd072c704af2950a9bb4339d374d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4fa9fd072c704af2950a9bb4339d374d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:53:07.489296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-VolumesSnapshotTestJSON-1554740344 Aug 24 17:53:07.489296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 4fa9fd072c704af2950a9bb4339d374d Aug 24 17:53:07.489296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1554740344 Aug 24 17:53:07.489296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-VolumesSnapshotTestJSON-1554740344-project Aug 24 17:53:07.489296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:53:07.489296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:53:07.489296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 7ca82f3632bc404691835a2db6167939 Aug 24 17:53:07.489296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-VolumesSnapshotTestJSON-1554740344-project Aug 24 17:53:07.489296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:53:07.489296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance 134fa9aa-ee04-40f4-807a-57429a1b55fd could not be found. Aug 24 17:53:07.489296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': '134fa9aa-ee04-40f4-807a-57429a1b55fd'} Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134fa9aa-ee04-40f4-807a-57429a1b55fd could not be found. Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:53:07.497244 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:53:07.498954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:53:07.498954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:53:07.498954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:53:07.498954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:53:07.498954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:53:07.498954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:53:07.498954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:53:07.498954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134fa9aa-ee04-40f4-807a-57429a1b55fd could not be found. Aug 24 17:53:07.498954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:53:07.498954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:53:07.498954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:53:07.498954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:07.498954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:53:07.498954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:53:07.498954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:53:07.498954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:53:07.498954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134fa9aa-ee04-40f4-807a-57429a1b55fd could not be found. Aug 24 17:53:07.498954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:53:07.501057 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ed837846-fc78-498f-838b-f6fc38503e18 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Returning 404 to user: Instance 134fa9aa-ee04-40f4-807a-57429a1b55fd could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:53:07.501057 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-ed837846-fc78-498f-838b-f6fc38503e18 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd" status: 404 len: 111 microversion: 2.1 time: 0.047115 Aug 24 17:53:07.501057 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 302/605] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:07 2022] GET /compute/v2.1/servers/134fa9aa-ee04-40f4-807a-57429a1b55fd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:53:07.513356 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d8bf0d98-2425-4e91-9ae0-00c504762624 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:07.513356 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d8bf0d98-2425-4e91-9ae0-00c504762624 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:07.519727 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d8bf0d98-2425-4e91-9ae0-00c504762624 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:07.520274 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d8bf0d98-2425-4e91-9ae0-00c504762624 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:07.520575 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d8bf0d98-2425-4e91-9ae0-00c504762624 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:07.521283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d8bf0d98-2425-4e91-9ae0-00c504762624 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:07.521732 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d8bf0d98-2425-4e91-9ae0-00c504762624 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:07.522344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d8bf0d98-2425-4e91-9ae0-00c504762624 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:07.870757 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-4673d118-3d9c-48f2-bb39-3f0fa1d93679 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Flavor limits 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:53:07.874160 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-4673d118-3d9c-48f2-bb39-3f0fa1d93679 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Image limits 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:53:07.874160 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-4673d118-3d9c-48f2-bb39-3f0fa1d93679 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Flavor pref 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:53:07.874160 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-4673d118-3d9c-48f2-bb39-3f0fa1d93679 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Image pref 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:53:07.874160 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-4673d118-3d9c-48f2-bb39-3f0fa1d93679 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:53:07.887280 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4673d118-3d9c-48f2-bb39-3f0fa1d93679 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:07.887778 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4673d118-3d9c-48f2-bb39-3f0fa1d93679 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:07.888460 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4673d118-3d9c-48f2-bb39-3f0fa1d93679 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:07.889234 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4673d118-3d9c-48f2-bb39-3f0fa1d93679 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:07.889762 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4673d118-3d9c-48f2-bb39-3f0fa1d93679 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:07.890406 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4673d118-3d9c-48f2-bb39-3f0fa1d93679 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:07.917702 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d8bf0d98-2425-4e91-9ae0-00c504762624 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:07.924255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d8bf0d98-2425-4e91-9ae0-00c504762624 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1680 microversion: 2.1 time: 0.431257 Aug 24 17:53:07.925565 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 303/606] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:07 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1680 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:07.935817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-805386fd-0d52-4eaa-8d8f-f41e536bc2ea tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:07.936441 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-805386fd-0d52-4eaa-8d8f-f41e536bc2ea tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:07.942652 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-4673d118-3d9c-48f2-bb39-3f0fa1d93679 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Getting quotas for project 6e895dd83dbf4458b7d6efaace0d209a. Resources: {'instances', 'ram', 'cores'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:53:07.948275 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-4673d118-3d9c-48f2-bb39-3f0fa1d93679 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Getting quotas for user f08b2eba50904dda89fb743c9cf28958 and project 6e895dd83dbf4458b7d6efaace0d209a. Resources: {'instances', 'ram', 'cores'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:53:07.952672 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-805386fd-0d52-4eaa-8d8f-f41e536bc2ea tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:07.953176 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-805386fd-0d52-4eaa-8d8f-f41e536bc2ea tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:07.953616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-805386fd-0d52-4eaa-8d8f-f41e536bc2ea tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:07.954365 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-805386fd-0d52-4eaa-8d8f-f41e536bc2ea tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:07.955127 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-805386fd-0d52-4eaa-8d8f-f41e536bc2ea tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:07.955427 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-805386fd-0d52-4eaa-8d8f-f41e536bc2ea tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:07.985875 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4673d118-3d9c-48f2-bb39-3f0fa1d93679 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Going to run 1 instances... {{(pid=127677) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:53:07.989748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4673d118-3d9c-48f2-bb39-3f0fa1d93679 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d76d745-abc6-4a7b-b8d7-46566b66934b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:53:08.222442 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-805386fd-0d52-4eaa-8d8f-f41e536bc2ea tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:08.234610 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-805386fd-0d52-4eaa-8d8f-f41e536bc2ea tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1267 microversion: 2.1 time: 0.304406 Aug 24 17:53:08.235695 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 304/607] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:07 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1267 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:08.288392 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-4673d118-3d9c-48f2-bb39-3f0fa1d93679 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.532587 Aug 24 17:53:08.294004 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 304/608] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 17:53:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:53:08.304309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-1b0262c4-dab8-42b3-9446-04849dcb49fc tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:08.304999 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-1b0262c4-dab8-42b3-9446-04849dcb49fc tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:08.386173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-1b0262c4-dab8-42b3-9446-04849dcb49fc tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:08.386173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-1b0262c4-dab8-42b3-9446-04849dcb49fc tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1214 microversion: 2.1 time: 0.083331 Aug 24 17:53:08.386173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 305/609] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:08 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:08.465831 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ce5b3b08-0dc0-43a8-afbc-4b5632736252 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:08.466506 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ce5b3b08-0dc0-43a8-afbc-4b5632736252 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:08.474944 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ce5b3b08-0dc0-43a8-afbc-4b5632736252 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:08.475482 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ce5b3b08-0dc0-43a8-afbc-4b5632736252 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:08.476046 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ce5b3b08-0dc0-43a8-afbc-4b5632736252 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:08.479640 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ce5b3b08-0dc0-43a8-afbc-4b5632736252 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:08.480284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ce5b3b08-0dc0-43a8-afbc-4b5632736252 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:08.480940 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ce5b3b08-0dc0-43a8-afbc-4b5632736252 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:08.513345 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-7e26a932-5e71-4966-ab93-6057997effe2 req-5286bc01-b8b6-4788-b07e-86b57f43fc7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd743b2-3b6c-4213-819a-1a25314ed5e2", "name": "network-vif-deleted", "tag": "c21554ce-e587-47c2-9a5e-61d889373e08"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:08.525991 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-7e26a932-5e71-4966-ab93-6057997effe2 req-5286bc01-b8b6-4788-b07e-86b57f43fc7c service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:08.526931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-7e26a932-5e71-4966-ab93-6057997effe2 req-5286bc01-b8b6-4788-b07e-86b57f43fc7c service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:08.527564 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-7e26a932-5e71-4966-ab93-6057997effe2 req-5286bc01-b8b6-4788-b07e-86b57f43fc7c service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:08.543281 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-7e26a932-5e71-4966-ab93-6057997effe2 req-5286bc01-b8b6-4788-b07e-86b57f43fc7c service nova] Creating event network-vif-deleted:c21554ce-e587-47c2-9a5e-61d889373e08 for instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 on hv-cinder-85442 Aug 24 17:53:08.551008 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-7e26a932-5e71-4966-ab93-6057997effe2 req-5286bc01-b8b6-4788-b07e-86b57f43fc7c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042212 Aug 24 17:53:08.557206 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 306/610] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:08.680699 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-ce5b3b08-0dc0-43a8-afbc-4b5632736252 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:08.689299 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ce5b3b08-0dc0-43a8-afbc-4b5632736252 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1676 microversion: 2.1 time: 0.228141 Aug 24 17:53:08.689888 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 305/611] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:08 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1676 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:08.958091 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e0748c73-2df6-4588-9d3f-fef559ced934 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:08.958809 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e0748c73-2df6-4588-9d3f-fef559ced934 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:08.966302 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e0748c73-2df6-4588-9d3f-fef559ced934 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:08.967004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e0748c73-2df6-4588-9d3f-fef559ced934 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:08.967655 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e0748c73-2df6-4588-9d3f-fef559ced934 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:08.968728 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e0748c73-2df6-4588-9d3f-fef559ced934 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:08.969336 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e0748c73-2df6-4588-9d3f-fef559ced934 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:08.969954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e0748c73-2df6-4588-9d3f-fef559ced934 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:09.048964 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e0748c73-2df6-4588-9d3f-fef559ced934 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:09.057903 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e0748c73-2df6-4588-9d3f-fef559ced934 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1613 microversion: 2.1 time: 0.109384 Aug 24 17:53:09.058482 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 307/612] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:08 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1613 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:09.257117 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-32ac214f-e24f-4a61-a9bd-51eb03df4963 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:09.257832 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-32ac214f-e24f-4a61-a9bd-51eb03df4963 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:09.263989 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-32ac214f-e24f-4a61-a9bd-51eb03df4963 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:09.264488 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-32ac214f-e24f-4a61-a9bd-51eb03df4963 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:09.264953 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-32ac214f-e24f-4a61-a9bd-51eb03df4963 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:09.265703 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-32ac214f-e24f-4a61-a9bd-51eb03df4963 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:09.266180 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-32ac214f-e24f-4a61-a9bd-51eb03df4963 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:09.266608 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-32ac214f-e24f-4a61-a9bd-51eb03df4963 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:09.409141 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a119f2e2-9d89-4507-ad21-4bfa031c9264 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:09.409761 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a119f2e2-9d89-4507-ad21-4bfa031c9264 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:09.417245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a119f2e2-9d89-4507-ad21-4bfa031c9264 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:09.417902 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a119f2e2-9d89-4507-ad21-4bfa031c9264 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:09.418350 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a119f2e2-9d89-4507-ad21-4bfa031c9264 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:09.419073 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a119f2e2-9d89-4507-ad21-4bfa031c9264 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:09.419524 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a119f2e2-9d89-4507-ad21-4bfa031c9264 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:09.419941 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a119f2e2-9d89-4507-ad21-4bfa031c9264 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:09.440376 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-32ac214f-e24f-4a61-a9bd-51eb03df4963 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:09.453898 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-32ac214f-e24f-4a61-a9bd-51eb03df4963 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1267 microversion: 2.1 time: 0.200606 Aug 24 17:53:09.455002 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 306/613] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:09 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:09.496119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a119f2e2-9d89-4507-ad21-4bfa031c9264 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:09.505136 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a119f2e2-9d89-4507-ad21-4bfa031c9264 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1218 microversion: 2.1 time: 0.100267 Aug 24 17:53:09.505717 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 308/614] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:09 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:09.710748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-546d93be-56db-4cf0-b046-d173d408298a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:09.711363 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-546d93be-56db-4cf0-b046-d173d408298a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:09.718331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-546d93be-56db-4cf0-b046-d173d408298a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:09.718818 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-546d93be-56db-4cf0-b046-d173d408298a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:09.719281 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-546d93be-56db-4cf0-b046-d173d408298a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:09.719987 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-546d93be-56db-4cf0-b046-d173d408298a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:09.720437 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-546d93be-56db-4cf0-b046-d173d408298a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:09.720861 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-546d93be-56db-4cf0-b046-d173d408298a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:09.863350 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-546d93be-56db-4cf0-b046-d173d408298a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:09.872553 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-546d93be-56db-4cf0-b046-d173d408298a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1676 microversion: 2.1 time: 0.165551 Aug 24 17:53:09.873266 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 307/615] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:09 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:10.080530 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f347435c-fbeb-4753-8059-41397d5e4785 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:10.081267 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f347435c-fbeb-4753-8059-41397d5e4785 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:10.088191 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f347435c-fbeb-4753-8059-41397d5e4785 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:10.088697 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f347435c-fbeb-4753-8059-41397d5e4785 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:10.089149 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f347435c-fbeb-4753-8059-41397d5e4785 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:10.089893 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f347435c-fbeb-4753-8059-41397d5e4785 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:10.090362 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f347435c-fbeb-4753-8059-41397d5e4785 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:10.090798 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f347435c-fbeb-4753-8059-41397d5e4785 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:10.179462 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f347435c-fbeb-4753-8059-41397d5e4785 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:10.188972 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f347435c-fbeb-4753-8059-41397d5e4785 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1613 microversion: 2.1 time: 0.112326 Aug 24 17:53:10.189593 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 309/616] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:10 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1613 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:10.475938 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e718af36-8073-47a0-ba59-cb41e0b7d8e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:10.484010 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-e718af36-8073-47a0-ba59-cb41e0b7d8e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:10.484165 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e718af36-8073-47a0-ba59-cb41e0b7d8e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:10.484625 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e718af36-8073-47a0-ba59-cb41e0b7d8e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:10.485207 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e718af36-8073-47a0-ba59-cb41e0b7d8e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:10.485842 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e718af36-8073-47a0-ba59-cb41e0b7d8e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:10.486285 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e718af36-8073-47a0-ba59-cb41e0b7d8e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:10.486715 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e718af36-8073-47a0-ba59-cb41e0b7d8e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:10.527721 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-bc74f451-ef7a-441c-8547-5b47fe8fd871 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:10.528509 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-bc74f451-ef7a-441c-8547-5b47fe8fd871 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:10.535269 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bc74f451-ef7a-441c-8547-5b47fe8fd871 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:10.535903 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bc74f451-ef7a-441c-8547-5b47fe8fd871 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:10.536340 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bc74f451-ef7a-441c-8547-5b47fe8fd871 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:10.537059 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bc74f451-ef7a-441c-8547-5b47fe8fd871 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:10.537531 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bc74f451-ef7a-441c-8547-5b47fe8fd871 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:10.537983 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bc74f451-ef7a-441c-8547-5b47fe8fd871 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:10.630265 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-bc74f451-ef7a-441c-8547-5b47fe8fd871 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:10.639936 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-bc74f451-ef7a-441c-8547-5b47fe8fd871 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1218 microversion: 2.1 time: 0.117155 Aug 24 17:53:10.641538 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 310/617] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:10 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:10.666584 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e718af36-8073-47a0-ba59-cb41e0b7d8e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:10.674794 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-e718af36-8073-47a0-ba59-cb41e0b7d8e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1267 microversion: 2.1 time: 0.203364 Aug 24 17:53:10.675382 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 308/618] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:10 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:10.894935 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-1d5cdb5d-0765-4fa3-a82d-0b078fa6c918 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:10.895465 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-1d5cdb5d-0765-4fa3-a82d-0b078fa6c918 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:10.901958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1d5cdb5d-0765-4fa3-a82d-0b078fa6c918 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:10.902463 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1d5cdb5d-0765-4fa3-a82d-0b078fa6c918 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:10.902903 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1d5cdb5d-0765-4fa3-a82d-0b078fa6c918 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:10.903615 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1d5cdb5d-0765-4fa3-a82d-0b078fa6c918 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:10.904074 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1d5cdb5d-0765-4fa3-a82d-0b078fa6c918 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:10.904508 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1d5cdb5d-0765-4fa3-a82d-0b078fa6c918 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:11.050085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-1d5cdb5d-0765-4fa3-a82d-0b078fa6c918 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:11.062722 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-1d5cdb5d-0765-4fa3-a82d-0b078fa6c918 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1676 microversion: 2.1 time: 0.171674 Aug 24 17:53:11.063612 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 311/619] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:10 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:11.217176 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-274b570b-959a-4ba4-b435-da087ce472d3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:11.218288 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-274b570b-959a-4ba4-b435-da087ce472d3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:11.226621 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-274b570b-959a-4ba4-b435-da087ce472d3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:11.227108 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-274b570b-959a-4ba4-b435-da087ce472d3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:11.227759 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-274b570b-959a-4ba4-b435-da087ce472d3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:11.228502 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-274b570b-959a-4ba4-b435-da087ce472d3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:11.228950 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-274b570b-959a-4ba4-b435-da087ce472d3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:11.229530 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-274b570b-959a-4ba4-b435-da087ce472d3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:11.301321 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-274b570b-959a-4ba4-b435-da087ce472d3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:11.310806 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-274b570b-959a-4ba4-b435-da087ce472d3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1613 microversion: 2.1 time: 0.100507 Aug 24 17:53:11.311408 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 309/620] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:11 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1613 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:11.664351 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f1a913eb-dbab-4633-a373-08f01cd21f64 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:11.665193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f1a913eb-dbab-4633-a373-08f01cd21f64 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:11.673939 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f1a913eb-dbab-4633-a373-08f01cd21f64 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:11.674437 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f1a913eb-dbab-4633-a373-08f01cd21f64 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:11.674879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f1a913eb-dbab-4633-a373-08f01cd21f64 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:11.675567 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f1a913eb-dbab-4633-a373-08f01cd21f64 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:11.676062 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f1a913eb-dbab-4633-a373-08f01cd21f64 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:11.676582 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f1a913eb-dbab-4633-a373-08f01cd21f64 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:11.698888 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e07bf111-7a12-40ac-a397-807346a60286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:11.699907 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-e07bf111-7a12-40ac-a397-807346a60286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:11.708882 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e07bf111-7a12-40ac-a397-807346a60286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:11.709618 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e07bf111-7a12-40ac-a397-807346a60286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:11.710138 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e07bf111-7a12-40ac-a397-807346a60286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:11.716851 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e07bf111-7a12-40ac-a397-807346a60286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:11.716851 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e07bf111-7a12-40ac-a397-807346a60286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:11.716851 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e07bf111-7a12-40ac-a397-807346a60286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:11.815173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f1a913eb-dbab-4633-a373-08f01cd21f64 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:11.826378 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f1a913eb-dbab-4633-a373-08f01cd21f64 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1218 microversion: 2.1 time: 0.166123 Aug 24 17:53:11.840864 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 312/621] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:11 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1218 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:11.964234 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e07bf111-7a12-40ac-a397-807346a60286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:11.973179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-e07bf111-7a12-40ac-a397-807346a60286 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1267 microversion: 2.1 time: 0.280123 Aug 24 17:53:11.973807 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 310/622] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:11 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1267 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:12.109145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f416e005-6e09-4691-9ba8-38de28c0ff92 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:12.109435 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f416e005-6e09-4691-9ba8-38de28c0ff92 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:12.116263 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f416e005-6e09-4691-9ba8-38de28c0ff92 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:12.116918 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f416e005-6e09-4691-9ba8-38de28c0ff92 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:12.117502 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f416e005-6e09-4691-9ba8-38de28c0ff92 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:12.118283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f416e005-6e09-4691-9ba8-38de28c0ff92 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:12.118935 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f416e005-6e09-4691-9ba8-38de28c0ff92 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:12.119574 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f416e005-6e09-4691-9ba8-38de28c0ff92 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:12.280547 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f416e005-6e09-4691-9ba8-38de28c0ff92 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:12.289016 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f416e005-6e09-4691-9ba8-38de28c0ff92 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1676 microversion: 2.1 time: 0.187359 Aug 24 17:53:12.289596 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 313/623] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:12 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1676 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:12.332606 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-68441884-56a7-4afd-8823-9247f232b000 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:12.333277 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-68441884-56a7-4afd-8823-9247f232b000 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:12.340518 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68441884-56a7-4afd-8823-9247f232b000 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:12.341004 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68441884-56a7-4afd-8823-9247f232b000 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:12.341470 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68441884-56a7-4afd-8823-9247f232b000 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:12.342221 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68441884-56a7-4afd-8823-9247f232b000 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:12.342691 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68441884-56a7-4afd-8823-9247f232b000 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:12.343292 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68441884-56a7-4afd-8823-9247f232b000 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:12.379476 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68441884-56a7-4afd-8823-9247f232b000 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:12.379978 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68441884-56a7-4afd-8823-9247f232b000 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:12.380474 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-68441884-56a7-4afd-8823-9247f232b000 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:12.380960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-68441884-56a7-4afd-8823-9247f232b000 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lazy-loading 'fault' on Instance uuid 8cd743b2-3b6c-4213-819a-1a25314ed5e2 {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:53:12.426063 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-68441884-56a7-4afd-8823-9247f232b000 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:12.433019 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-68441884-56a7-4afd-8823-9247f232b000 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 200 len: 1330 microversion: 2.1 time: 0.104469 Aug 24 17:53:12.433698 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 311/624] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:12 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:12.847679 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-6b728ad6-f0b0-49f1-9fff-ee3c7a34b16f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:12.848501 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-6b728ad6-f0b0-49f1-9fff-ee3c7a34b16f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:12.858399 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6b728ad6-f0b0-49f1-9fff-ee3c7a34b16f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:12.859060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6b728ad6-f0b0-49f1-9fff-ee3c7a34b16f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:12.859515 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6b728ad6-f0b0-49f1-9fff-ee3c7a34b16f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:12.860281 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6b728ad6-f0b0-49f1-9fff-ee3c7a34b16f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:12.860749 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6b728ad6-f0b0-49f1-9fff-ee3c7a34b16f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:12.861205 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6b728ad6-f0b0-49f1-9fff-ee3c7a34b16f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:12.941193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-6b728ad6-f0b0-49f1-9fff-ee3c7a34b16f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:12.949363 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-6b728ad6-f0b0-49f1-9fff-ee3c7a34b16f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1266 microversion: 2.1 time: 0.105577 Aug 24 17:53:12.949968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 314/625] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:12 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1266 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:13.004187 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-87d4fad8-352e-4827-bf8c-d3e1f1c9cfd2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:13.005232 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-87d4fad8-352e-4827-bf8c-d3e1f1c9cfd2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:13.016403 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-87d4fad8-352e-4827-bf8c-d3e1f1c9cfd2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:13.017287 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-87d4fad8-352e-4827-bf8c-d3e1f1c9cfd2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:13.018127 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-87d4fad8-352e-4827-bf8c-d3e1f1c9cfd2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:13.019423 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-87d4fad8-352e-4827-bf8c-d3e1f1c9cfd2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:13.020261 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-87d4fad8-352e-4827-bf8c-d3e1f1c9cfd2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:13.021049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-87d4fad8-352e-4827-bf8c-d3e1f1c9cfd2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:13.208051 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-87d4fad8-352e-4827-bf8c-d3e1f1c9cfd2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:13.220585 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-87d4fad8-352e-4827-bf8c-d3e1f1c9cfd2 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1454 microversion: 2.1 time: 0.222894 Aug 24 17:53:13.221189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 312/626] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:12 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1454 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:13.251373 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-fa04262e-2a03-4e3f-994f-da76e450f098 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:13.270587 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-fa04262e-2a03-4e3f-994f-da76e450f098 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:13.270587 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fa04262e-2a03-4e3f-994f-da76e450f098 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:13.270587 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fa04262e-2a03-4e3f-994f-da76e450f098 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:13.270587 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fa04262e-2a03-4e3f-994f-da76e450f098 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:13.271138 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fa04262e-2a03-4e3f-994f-da76e450f098 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:13.271138 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fa04262e-2a03-4e3f-994f-da76e450f098 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:13.271138 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fa04262e-2a03-4e3f-994f-da76e450f098 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:13.312743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ca82f329-6658-4bf6-aaee-c71e28666ada tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:13.313317 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ca82f329-6658-4bf6-aaee-c71e28666ada tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:13.320086 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ca82f329-6658-4bf6-aaee-c71e28666ada tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:13.320633 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ca82f329-6658-4bf6-aaee-c71e28666ada tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:13.321088 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ca82f329-6658-4bf6-aaee-c71e28666ada tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:13.321890 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ca82f329-6658-4bf6-aaee-c71e28666ada tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:13.323226 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ca82f329-6658-4bf6-aaee-c71e28666ada tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:13.323226 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ca82f329-6658-4bf6-aaee-c71e28666ada tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:13.577112 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-fa04262e-2a03-4e3f-994f-da76e450f098 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:13.585060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-fa04262e-2a03-4e3f-994f-da76e450f098 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1454 microversion: 2.1 time: 0.337620 Aug 24 17:53:13.585635 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 315/627] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:13 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1454 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:13.591450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-05f73e64-31d0-47db-99a7-430ff63379bf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:13.591991 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-05f73e64-31d0-47db-99a7-430ff63379bf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:13.595102 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=100 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:13.598662 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-05f73e64-31d0-47db-99a7-430ff63379bf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:13.599156 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-05f73e64-31d0-47db-99a7-430ff63379bf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:13.599949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-05f73e64-31d0-47db-99a7-430ff63379bf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:13.600284 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-05f73e64-31d0-47db-99a7-430ff63379bf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:13.600859 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-05f73e64-31d0-47db-99a7-430ff63379bf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:13.601291 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-05f73e64-31d0-47db-99a7-430ff63379bf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:13.621562 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-05f73e64-31d0-47db-99a7-430ff63379bf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] HTTP exception thrown: Instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 could not be found. Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-05f73e64-31d0-47db-99a7-430ff63379bf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Request method failure captured: Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 HTTP/1.1 Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmSbnOSGx7e91Bj6OLQvb6olH3rhtuwbwgCFF2TiEJuGnQyAMTLci2PNua_H1N1Jgo-7CaRuKelcRsW8AHd-7NBHe9Qv1DY7-HELa-jl_G34ACZrF6UPOZU70uNjUu-29pkZxRoJdko5GsGgd7qyf34-jqX4JFHPGtUaryYBDPnp0Vk Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:53:13.623377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:53:13.624652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0a4d7fadea104c569ca29ff9be48089a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:53:13.624652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:53:13.624652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:53:13.624652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:53:13.624652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:53:13.624652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:53:13.624652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:53:13.624652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 251bc85f89774142a97acd77895b14e9 Aug 24 17:53:13.624652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:53:13.624652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:53:13.624652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 could not be found. Aug 24 17:53:13.624652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': '8cd743b2-3b6c-4213-819a-1a25314ed5e2'} Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 could not be found. Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:53:13.625895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:53:13.627064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:53:13.627064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:53:13.627064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:53:13.627064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:53:13.627064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:53:13.627064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:53:13.627064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:53:13.627064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 could not be found. Aug 24 17:53:13.627064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:53:13.627064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:53:13.627064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:53:13.627064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:13.627064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:53:13.627064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:53:13.627064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:53:13.627064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:53:13.627064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 could not be found. Aug 24 17:53:13.627064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:53:13.628070 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-05f73e64-31d0-47db-99a7-430ff63379bf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Returning 404 to user: Instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:53:13.628070 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-05f73e64-31d0-47db-99a7-430ff63379bf tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 404 len: 111 microversion: 2.1 time: 0.038195 Aug 24 17:53:13.628904 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 316/628] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:13 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:53:13.633361 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-ca82f329-6658-4bf6-aaee-c71e28666ada tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:13.634028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-9c7807d8-c694-4813-835b-2dfdfdf51708 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '.version_select at 0x7fce774544c0>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:13.661304 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ca82f329-6658-4bf6-aaee-c71e28666ada tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1676 microversion: 2.1 time: 0.353194 Aug 24 17:53:13.662245 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 313/629] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:13 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1676 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:13.734846 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-9c7807d8-c694-4813-835b-2dfdfdf51708 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-760398761" status: 202 len: 0 microversion: 2.1 time: 0.104090 Aug 24 17:53:13.735708 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 317/630] 10.222.0.76 () {58 vars in 1218 bytes} [Wed Aug 24 17:53:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-760398761 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:53:13.975639 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d1f13d3a-7265-43c7-93a3-e22a43c45b3c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:13.976565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d1f13d3a-7265-43c7-93a3-e22a43c45b3c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:13.991348 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d1f13d3a-7265-43c7-93a3-e22a43c45b3c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:13.991967 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d1f13d3a-7265-43c7-93a3-e22a43c45b3c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:13.992515 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d1f13d3a-7265-43c7-93a3-e22a43c45b3c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:13.993350 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d1f13d3a-7265-43c7-93a3-e22a43c45b3c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:13.994038 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d1f13d3a-7265-43c7-93a3-e22a43c45b3c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:13.994619 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d1f13d3a-7265-43c7-93a3-e22a43c45b3c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:14.075464 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d1f13d3a-7265-43c7-93a3-e22a43c45b3c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:14.090950 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d1f13d3a-7265-43c7-93a3-e22a43c45b3c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1272 microversion: 2.1 time: 0.119051 Aug 24 17:53:14.101902 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 314/631] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:13 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1272 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:14.684765 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-49f8cfe1-728c-4713-a7cd-51957de240fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:14.685388 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-49f8cfe1-728c-4713-a7cd-51957de240fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:14.691730 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49f8cfe1-728c-4713-a7cd-51957de240fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:14.692471 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49f8cfe1-728c-4713-a7cd-51957de240fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:14.693084 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49f8cfe1-728c-4713-a7cd-51957de240fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:14.693800 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49f8cfe1-728c-4713-a7cd-51957de240fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:14.694419 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49f8cfe1-728c-4713-a7cd-51957de240fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:14.694730 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49f8cfe1-728c-4713-a7cd-51957de240fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:15.014492 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-49f8cfe1-728c-4713-a7cd-51957de240fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:15.024092 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-49f8cfe1-728c-4713-a7cd-51957de240fe tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1676 microversion: 2.1 time: 0.344387 Aug 24 17:53:15.025662 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 318/632] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:14 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1676 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:15.112962 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d274ee84-d07b-46bd-bf95-4b81ee76dbc3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:15.113583 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d274ee84-d07b-46bd-bf95-4b81ee76dbc3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:15.121800 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d274ee84-d07b-46bd-bf95-4b81ee76dbc3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:15.122835 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d274ee84-d07b-46bd-bf95-4b81ee76dbc3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:15.123319 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d274ee84-d07b-46bd-bf95-4b81ee76dbc3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:15.124055 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d274ee84-d07b-46bd-bf95-4b81ee76dbc3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:15.124547 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d274ee84-d07b-46bd-bf95-4b81ee76dbc3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:15.125143 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d274ee84-d07b-46bd-bf95-4b81ee76dbc3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:15.186937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7cd4cb51-ea23-4aa9-b244-9ee2cae51d49 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Action: 'create', calling method: .version_select at 0x7fce77547310>, body: {"keypair": {"name": "tempest-keypair-1159583184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2x+ZMDv9fsB+VJMyz9nYPiQhr4L4ZznjD6/CYwSIFLRWlwPfuNUPUQL66OguqzQTMDg0H8MXHaLGiiUu/KybA1zuIdI3af9BLIkrRgLqklMtjnxWsB3YSb58lJj4OhkQ=="}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:15.203590 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-7cd4cb51-ea23-4aa9-b244-9ee2cae51d49 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Getting quotas for project 0a4d7fadea104c569ca29ff9be48089a. Resources: {'key_pairs'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:53:15.207917 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-7cd4cb51-ea23-4aa9-b244-9ee2cae51d49 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Getting quotas for user 251bc85f89774142a97acd77895b14e9 and project 0a4d7fadea104c569ca29ff9be48089a. Resources: {'key_pairs'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:53:15.325152 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7cd4cb51-ea23-4aa9-b244-9ee2cae51d49 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.142111 Aug 24 17:53:15.325768 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 319/633] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 17:53:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:15.368361 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d274ee84-d07b-46bd-bf95-4b81ee76dbc3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:15.377774 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d274ee84-d07b-46bd-bf95-4b81ee76dbc3 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1314 microversion: 2.1 time: 0.268727 Aug 24 17:53:15.378713 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 315/634] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:15 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:16.048902 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d46273ec-a645-44af-8b8c-2063c04e39a5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:16.049603 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d46273ec-a645-44af-8b8c-2063c04e39a5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:16.056483 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d46273ec-a645-44af-8b8c-2063c04e39a5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:16.057207 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d46273ec-a645-44af-8b8c-2063c04e39a5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:16.057652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d46273ec-a645-44af-8b8c-2063c04e39a5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:16.058392 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d46273ec-a645-44af-8b8c-2063c04e39a5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:16.058855 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d46273ec-a645-44af-8b8c-2063c04e39a5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:16.059285 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d46273ec-a645-44af-8b8c-2063c04e39a5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:16.208202 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d46273ec-a645-44af-8b8c-2063c04e39a5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:16.217021 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d46273ec-a645-44af-8b8c-2063c04e39a5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1676 microversion: 2.1 time: 0.172550 Aug 24 17:53:16.228921 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 320/635] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:16 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:16.399788 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-37e15d51-26ed-47c0-a8ae-6ecc31c440cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:16.401052 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-37e15d51-26ed-47c0-a8ae-6ecc31c440cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:16.407552 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-37e15d51-26ed-47c0-a8ae-6ecc31c440cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:16.408042 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-37e15d51-26ed-47c0-a8ae-6ecc31c440cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:16.408474 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-37e15d51-26ed-47c0-a8ae-6ecc31c440cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:16.409174 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-37e15d51-26ed-47c0-a8ae-6ecc31c440cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:16.409633 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-37e15d51-26ed-47c0-a8ae-6ecc31c440cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:16.410157 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-37e15d51-26ed-47c0-a8ae-6ecc31c440cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:16.653437 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-37e15d51-26ed-47c0-a8ae-6ecc31c440cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:16.661544 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-37e15d51-26ed-47c0-a8ae-6ecc31c440cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1314 microversion: 2.1 time: 0.265946 Aug 24 17:53:16.662158 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 316/636] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:16 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:16.924406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-8ead4b23-e26a-42d8-8ba0-8e57246c2ce9 req-8d3c3295-3975-4f16-bc2c-802169de8859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829f4d8c-fcd5-4611-9878-af9c7b30e362", "tag": "7aa9edde-92b1-4e33-9fe7-371de05db5c9"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:16.935580 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-8ead4b23-e26a-42d8-8ba0-8e57246c2ce9 req-8d3c3295-3975-4f16-bc2c-802169de8859 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:16.936581 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-8ead4b23-e26a-42d8-8ba0-8e57246c2ce9 req-8d3c3295-3975-4f16-bc2c-802169de8859 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:16.937146 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-8ead4b23-e26a-42d8-8ba0-8e57246c2ce9 req-8d3c3295-3975-4f16-bc2c-802169de8859 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:16.951463 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-8ead4b23-e26a-42d8-8ba0-8e57246c2ce9 req-8d3c3295-3975-4f16-bc2c-802169de8859 service nova] Creating event network-changed:7aa9edde-92b1-4e33-9fe7-371de05db5c9 for instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 on hv-cinder-85442 Aug 24 17:53:16.956732 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-8ead4b23-e26a-42d8-8ba0-8e57246c2ce9 req-8d3c3295-3975-4f16-bc2c-802169de8859 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036171 Aug 24 17:53:16.957818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 321/637] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:17.240385 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-bf9fad3d-ab13-458d-8dc9-bf2619940b4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:17.241305 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-bf9fad3d-ab13-458d-8dc9-bf2619940b4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:17.250405 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bf9fad3d-ab13-458d-8dc9-bf2619940b4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:17.251229 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bf9fad3d-ab13-458d-8dc9-bf2619940b4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:17.251661 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bf9fad3d-ab13-458d-8dc9-bf2619940b4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:17.252561 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bf9fad3d-ab13-458d-8dc9-bf2619940b4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:17.253019 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bf9fad3d-ab13-458d-8dc9-bf2619940b4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:17.253580 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bf9fad3d-ab13-458d-8dc9-bf2619940b4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:17.513471 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-bf9fad3d-ab13-458d-8dc9-bf2619940b4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:17.522756 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-bf9fad3d-ab13-458d-8dc9-bf2619940b4e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1676 microversion: 2.1 time: 0.286891 Aug 24 17:53:17.523971 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 317/638] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:17 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1676 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:17.686426 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-34e96e25-3e40-4041-aa51-58ac3ffd2c94 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:17.687761 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-34e96e25-3e40-4041-aa51-58ac3ffd2c94 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:17.701372 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-34e96e25-3e40-4041-aa51-58ac3ffd2c94 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:17.703745 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-34e96e25-3e40-4041-aa51-58ac3ffd2c94 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:17.704418 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-34e96e25-3e40-4041-aa51-58ac3ffd2c94 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:17.709263 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-34e96e25-3e40-4041-aa51-58ac3ffd2c94 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:17.710592 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-34e96e25-3e40-4041-aa51-58ac3ffd2c94 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:17.711735 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-34e96e25-3e40-4041-aa51-58ac3ffd2c94 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:17.751532 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=100 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:17.947692 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-34e96e25-3e40-4041-aa51-58ac3ffd2c94 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:17.961928 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-34e96e25-3e40-4041-aa51-58ac3ffd2c94 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1314 microversion: 2.1 time: 0.281687 Aug 24 17:53:17.964184 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 322/639] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:17 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:18.126396 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3cfd0bb2-169e-4bcf-b566-1643c19e494d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-472157943", "imageRef": "2d76d745-abc6-4a7b-b8d7-46566b66934b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60b1f9c5-31f3-434f-b4cc-45bc1ad7c5b8"}], "security_groups": [{"name": "tempest-securitygroup--337665"}], "key_name": "tempest-keypair-1159583184", "user_data": "}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:18.141286 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=2 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:18.142007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=6 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:18.274403 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.network.neutron [None req-3cfd0bb2-169e-4bcf-b566-1643c19e494d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] validate_networks() for [('60b1f9c5-31f3-434f-b4cc-45bc1ad7c5b8', None, None, None, None, None)] {{(pid=127677) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:53:18.511774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-4cda5d3a-5f97-43a7-8a0e-963c50322473 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1624891524", "imageRef": "2d76d745-abc6-4a7b-b8d7-46566b66934b", "flavorRef": "452", "networks": [{"uuid": "b2faca5a-e8af-4323-908b-3df82d9ff4a6"}]}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:18.585431 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.network.neutron [None req-4cda5d3a-5f97-43a7-8a0e-963c50322473 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] validate_networks() for [('b2faca5a-e8af-4323-908b-3df82d9ff4a6', None, None, None, None, None)] {{(pid=127676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:53:19.409100 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-3cfd0bb2-169e-4bcf-b566-1643c19e494d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Flavor limits 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:53:19.409746 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-3cfd0bb2-169e-4bcf-b566-1643c19e494d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Image limits 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:53:19.410030 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-3cfd0bb2-169e-4bcf-b566-1643c19e494d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Flavor pref 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:53:19.410438 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-3cfd0bb2-169e-4bcf-b566-1643c19e494d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Image pref 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:53:19.410856 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-3cfd0bb2-169e-4bcf-b566-1643c19e494d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:53:19.421447 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3cfd0bb2-169e-4bcf-b566-1643c19e494d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:19.421926 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3cfd0bb2-169e-4bcf-b566-1643c19e494d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:19.422368 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3cfd0bb2-169e-4bcf-b566-1643c19e494d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:19.423097 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3cfd0bb2-169e-4bcf-b566-1643c19e494d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:19.423560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3cfd0bb2-169e-4bcf-b566-1643c19e494d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:19.423991 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3cfd0bb2-169e-4bcf-b566-1643c19e494d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:19.443645 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-3cfd0bb2-169e-4bcf-b566-1643c19e494d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Getting quotas for project 0a4d7fadea104c569ca29ff9be48089a. Resources: {'instances', 'ram', 'cores'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:53:19.448879 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-3cfd0bb2-169e-4bcf-b566-1643c19e494d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Getting quotas for user 251bc85f89774142a97acd77895b14e9 and project 0a4d7fadea104c569ca29ff9be48089a. Resources: {'instances', 'ram', 'cores'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:53:19.462121 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3cfd0bb2-169e-4bcf-b566-1643c19e494d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Going to run 1 instances... {{(pid=127677) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:53:19.465109 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3cfd0bb2-169e-4bcf-b566-1643c19e494d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d76d745-abc6-4a7b-b8d7-46566b66934b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:53:19.566937 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3cfd0bb2-169e-4bcf-b566-1643c19e494d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.1 time: 1.449687 Aug 24 17:53:19.567791 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 318/640] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 17:53:18 2022] POST /compute/v2.1/servers => generated 398 bytes in 1451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:53:19.573503 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a87377d1-e054-4f61-b28c-af54c667b0ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:19.574229 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a87377d1-e054-4f61-b28c-af54c667b0ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:19.581562 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a87377d1-e054-4f61-b28c-af54c667b0ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:19.581562 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a87377d1-e054-4f61-b28c-af54c667b0ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:19.592501 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a87377d1-e054-4f61-b28c-af54c667b0ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:19.592501 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a87377d1-e054-4f61-b28c-af54c667b0ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:19.592501 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a87377d1-e054-4f61-b28c-af54c667b0ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:19.592501 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a87377d1-e054-4f61-b28c-af54c667b0ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:19.717762 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-4cda5d3a-5f97-43a7-8a0e-963c50322473 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Flavor limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:53:19.718784 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-4cda5d3a-5f97-43a7-8a0e-963c50322473 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Image limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:53:19.719347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-4cda5d3a-5f97-43a7-8a0e-963c50322473 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Flavor pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:53:19.719767 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-4cda5d3a-5f97-43a7-8a0e-963c50322473 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Image pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:53:19.720600 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-4cda5d3a-5f97-43a7-8a0e-963c50322473 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:53:19.736113 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4cda5d3a-5f97-43a7-8a0e-963c50322473 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:19.737529 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4cda5d3a-5f97-43a7-8a0e-963c50322473 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:19.738002 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4cda5d3a-5f97-43a7-8a0e-963c50322473 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:19.741864 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4cda5d3a-5f97-43a7-8a0e-963c50322473 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:19.742362 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4cda5d3a-5f97-43a7-8a0e-963c50322473 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:19.742975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4cda5d3a-5f97-43a7-8a0e-963c50322473 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:19.774947 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-4cda5d3a-5f97-43a7-8a0e-963c50322473 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Getting quotas for project 4fa9fd072c704af2950a9bb4339d374d. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:53:19.781433 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-4cda5d3a-5f97-43a7-8a0e-963c50322473 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Getting quotas for user 7ca82f3632bc404691835a2db6167939 and project 4fa9fd072c704af2950a9bb4339d374d. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:53:19.794421 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4cda5d3a-5f97-43a7-8a0e-963c50322473 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Going to run 1 instances... {{(pid=127676) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:53:19.799261 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a87377d1-e054-4f61-b28c-af54c667b0ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:19.799489 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4cda5d3a-5f97-43a7-8a0e-963c50322473 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d76d745-abc6-4a7b-b8d7-46566b66934b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:53:19.805762 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a87377d1-e054-4f61-b28c-af54c667b0ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1676 microversion: 2.1 time: 0.236995 Aug 24 17:53:19.807232 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 319/641] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:19 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1676 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:19.813065 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-eaea6b35-7177-41f9-88ff-d789e2d3e677 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:19.814069 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-eaea6b35-7177-41f9-88ff-d789e2d3e677 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:19.826966 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eaea6b35-7177-41f9-88ff-d789e2d3e677 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:19.827457 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eaea6b35-7177-41f9-88ff-d789e2d3e677 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:19.827899 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eaea6b35-7177-41f9-88ff-d789e2d3e677 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:19.828604 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eaea6b35-7177-41f9-88ff-d789e2d3e677 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:19.829068 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eaea6b35-7177-41f9-88ff-d789e2d3e677 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:19.829500 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-eaea6b35-7177-41f9-88ff-d789e2d3e677 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:19.963279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-4cda5d3a-5f97-43a7-8a0e-963c50322473 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.455913 Aug 24 17:53:19.970700 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 323/642] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 17:53:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:53:19.974504 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-958d28c1-cd75-47f0-bbff-f83aff78a7f5 req-96895b95-212c-4dbb-9520-3a6cfea7e185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a6ce1f4-195d-4f47-aa97-ca63353379cc", "tag": "8da2ef24-6418-47bd-9b86-9b7fbc7181f5"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:19.974690 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-eaea6b35-7177-41f9-88ff-d789e2d3e677 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:19.978268 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=100 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:19.985971 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-958d28c1-cd75-47f0-bbff-f83aff78a7f5 req-96895b95-212c-4dbb-9520-3a6cfea7e185 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:19.986464 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-958d28c1-cd75-47f0-bbff-f83aff78a7f5 req-96895b95-212c-4dbb-9520-3a6cfea7e185 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:19.986902 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-958d28c1-cd75-47f0-bbff-f83aff78a7f5 req-96895b95-212c-4dbb-9520-3a6cfea7e185 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:19.990627 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-eaea6b35-7177-41f9-88ff-d789e2d3e677 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1314 microversion: 2.1 time: 0.182037 Aug 24 17:53:19.991226 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 320/643] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:19 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:19.999102 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1610eda4-8562-438d-af07-b810d3ecc3a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:20.000250 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1610eda4-8562-438d-af07-b810d3ecc3a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:20.003865 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-958d28c1-cd75-47f0-bbff-f83aff78a7f5 req-96895b95-212c-4dbb-9520-3a6cfea7e185 service nova] Creating event network-changed:8da2ef24-6418-47bd-9b86-9b7fbc7181f5 for instance 5a6ce1f4-195d-4f47-aa97-ca63353379cc on hv-cinder-85442 Aug 24 17:53:20.015795 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-958d28c1-cd75-47f0-bbff-f83aff78a7f5 req-96895b95-212c-4dbb-9520-3a6cfea7e185 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047439 Aug 24 17:53:20.015795 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 324/644] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:20.026041 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-039dd073-031b-4fe2-88fe-45d625c9b893 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:20.027369 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-039dd073-031b-4fe2-88fe-45d625c9b893 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:20.082845 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1610eda4-8562-438d-af07-b810d3ecc3a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:20.091580 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1610eda4-8562-438d-af07-b810d3ecc3a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1241 microversion: 2.1 time: 0.099087 Aug 24 17:53:20.092248 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 321/645] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:19 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:20.101027 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-039dd073-031b-4fe2-88fe-45d625c9b893 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:20.110191 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-039dd073-031b-4fe2-88fe-45d625c9b893 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 200 len: 1219 microversion: 2.1 time: 0.093597 Aug 24 17:53:20.110810 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 325/646] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:20 2022] GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:20.829195 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9cbd5f12-6bff-4a6a-974c-4f64a253490c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:20.829874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9cbd5f12-6bff-4a6a-974c-4f64a253490c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:20.837223 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9cbd5f12-6bff-4a6a-974c-4f64a253490c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:20.838194 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9cbd5f12-6bff-4a6a-974c-4f64a253490c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:20.838644 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9cbd5f12-6bff-4a6a-974c-4f64a253490c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:20.839692 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9cbd5f12-6bff-4a6a-974c-4f64a253490c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:20.840239 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9cbd5f12-6bff-4a6a-974c-4f64a253490c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:20.840686 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9cbd5f12-6bff-4a6a-974c-4f64a253490c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:21.012602 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-73011e0f-ca8b-4ca6-9348-8b75d287c34b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:21.013429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-73011e0f-ca8b-4ca6-9348-8b75d287c34b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:21.020735 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-73011e0f-ca8b-4ca6-9348-8b75d287c34b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:21.026047 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-73011e0f-ca8b-4ca6-9348-8b75d287c34b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:21.026047 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-73011e0f-ca8b-4ca6-9348-8b75d287c34b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:21.026047 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-73011e0f-ca8b-4ca6-9348-8b75d287c34b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:21.026047 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-73011e0f-ca8b-4ca6-9348-8b75d287c34b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:21.026914 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-73011e0f-ca8b-4ca6-9348-8b75d287c34b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:21.135304 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9cbd5f12-6bff-4a6a-974c-4f64a253490c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:21.143627 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9cbd5f12-6bff-4a6a-974c-4f64a253490c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1676 microversion: 2.1 time: 0.318173 Aug 24 17:53:21.144208 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 322/647] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:20 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1676 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:21.149467 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-5cbc88b5-0962-418d-a6a9-651fd5b07a63 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:21.150279 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-5cbc88b5-0962-418d-a6a9-651fd5b07a63 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:21.156960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5cbc88b5-0962-418d-a6a9-651fd5b07a63 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:21.157649 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5cbc88b5-0962-418d-a6a9-651fd5b07a63 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:21.158129 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5cbc88b5-0962-418d-a6a9-651fd5b07a63 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:21.158928 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5cbc88b5-0962-418d-a6a9-651fd5b07a63 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:21.159417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5cbc88b5-0962-418d-a6a9-651fd5b07a63 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:21.160399 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5cbc88b5-0962-418d-a6a9-651fd5b07a63 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:21.282072 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5cbc88b5-0962-418d-a6a9-651fd5b07a63 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:21.290536 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-5cbc88b5-0962-418d-a6a9-651fd5b07a63 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1245 microversion: 2.1 time: 0.145113 Aug 24 17:53:21.292237 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 323/648] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:21 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1245 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:21.296440 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a2141102-3a5b-43f5-a4ac-d8abe0fd0931 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:21.297355 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a2141102-3a5b-43f5-a4ac-d8abe0fd0931 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:21.304351 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a2141102-3a5b-43f5-a4ac-d8abe0fd0931 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:21.304842 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a2141102-3a5b-43f5-a4ac-d8abe0fd0931 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:21.305302 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a2141102-3a5b-43f5-a4ac-d8abe0fd0931 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:21.306631 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a2141102-3a5b-43f5-a4ac-d8abe0fd0931 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:21.307262 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a2141102-3a5b-43f5-a4ac-d8abe0fd0931 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:21.307691 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a2141102-3a5b-43f5-a4ac-d8abe0fd0931 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:21.328286 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-73011e0f-ca8b-4ca6-9348-8b75d287c34b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:21.336964 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-73011e0f-ca8b-4ca6-9348-8b75d287c34b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1314 microversion: 2.1 time: 0.328885 Aug 24 17:53:21.337719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 326/649] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:21 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:21.396148 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a2141102-3a5b-43f5-a4ac-d8abe0fd0931 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:21.411381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a2141102-3a5b-43f5-a4ac-d8abe0fd0931 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 200 len: 1223 microversion: 2.1 time: 0.118554 Aug 24 17:53:21.422225 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 324/650] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:21 2022] GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 1223 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:22.169815 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d57a6d8c-6614-4203-9b21-bb4aeb250602 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:22.170525 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d57a6d8c-6614-4203-9b21-bb4aeb250602 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:22.177708 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d57a6d8c-6614-4203-9b21-bb4aeb250602 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:22.178252 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d57a6d8c-6614-4203-9b21-bb4aeb250602 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:22.178690 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d57a6d8c-6614-4203-9b21-bb4aeb250602 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:22.179443 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d57a6d8c-6614-4203-9b21-bb4aeb250602 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:22.179897 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d57a6d8c-6614-4203-9b21-bb4aeb250602 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:22.180321 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d57a6d8c-6614-4203-9b21-bb4aeb250602 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:22.312023 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a479a266-81ee-417e-a800-9dac9f690254 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:22.312818 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a479a266-81ee-417e-a800-9dac9f690254 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:22.319766 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a479a266-81ee-417e-a800-9dac9f690254 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:22.320273 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a479a266-81ee-417e-a800-9dac9f690254 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:22.320715 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a479a266-81ee-417e-a800-9dac9f690254 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:22.321543 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a479a266-81ee-417e-a800-9dac9f690254 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:22.322023 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a479a266-81ee-417e-a800-9dac9f690254 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:22.322473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a479a266-81ee-417e-a800-9dac9f690254 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:22.335822 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d57a6d8c-6614-4203-9b21-bb4aeb250602 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:22.344398 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d57a6d8c-6614-4203-9b21-bb4aeb250602 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1676 microversion: 2.1 time: 0.179758 Aug 24 17:53:22.344973 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 327/651] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:22 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:22.359914 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-cbfffc10-f2f8-49b6-83a2-31e472065c1c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:22.360918 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-cbfffc10-f2f8-49b6-83a2-31e472065c1c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:22.369399 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cbfffc10-f2f8-49b6-83a2-31e472065c1c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:22.370483 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cbfffc10-f2f8-49b6-83a2-31e472065c1c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:22.371094 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cbfffc10-f2f8-49b6-83a2-31e472065c1c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:22.371995 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cbfffc10-f2f8-49b6-83a2-31e472065c1c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:22.372602 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cbfffc10-f2f8-49b6-83a2-31e472065c1c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:22.373256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cbfffc10-f2f8-49b6-83a2-31e472065c1c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:22.413278 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a479a266-81ee-417e-a800-9dac9f690254 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:22.422570 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a479a266-81ee-417e-a800-9dac9f690254 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1301 microversion: 2.1 time: 0.114612 Aug 24 17:53:22.423180 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 325/652] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:22 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1301 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:22.434963 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-2158a819-17d0-41d6-ba82-b6069d8b96a3 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:22.435961 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-2158a819-17d0-41d6-ba82-b6069d8b96a3 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:22.438229 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:22.443010 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2158a819-17d0-41d6-ba82-b6069d8b96a3 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:22.443528 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2158a819-17d0-41d6-ba82-b6069d8b96a3 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:22.443968 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2158a819-17d0-41d6-ba82-b6069d8b96a3 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:22.444669 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2158a819-17d0-41d6-ba82-b6069d8b96a3 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:22.445125 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2158a819-17d0-41d6-ba82-b6069d8b96a3 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:22.445584 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2158a819-17d0-41d6-ba82-b6069d8b96a3 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:22.554991 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-2158a819-17d0-41d6-ba82-b6069d8b96a3 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:22.563258 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-2158a819-17d0-41d6-ba82-b6069d8b96a3 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 200 len: 1271 microversion: 2.1 time: 0.132935 Aug 24 17:53:22.563875 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 326/653] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:22 2022] GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 1271 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:22.648517 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-cbfffc10-f2f8-49b6-83a2-31e472065c1c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:22.657137 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-cbfffc10-f2f8-49b6-83a2-31e472065c1c tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1314 microversion: 2.1 time: 0.302777 Aug 24 17:53:22.658990 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 328/654] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:22 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:23.372208 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-507fbfe9-8e9f-449a-a9c1-0513da01dabf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:23.373500 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-507fbfe9-8e9f-449a-a9c1-0513da01dabf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:23.381252 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-507fbfe9-8e9f-449a-a9c1-0513da01dabf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:23.381751 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-507fbfe9-8e9f-449a-a9c1-0513da01dabf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:23.382223 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-507fbfe9-8e9f-449a-a9c1-0513da01dabf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:23.382930 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-507fbfe9-8e9f-449a-a9c1-0513da01dabf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:23.383385 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-507fbfe9-8e9f-449a-a9c1-0513da01dabf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:23.383811 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-507fbfe9-8e9f-449a-a9c1-0513da01dabf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:23.444207 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-88c9b3de-2496-4a20-92a0-5c60f8156756 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:23.444831 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-88c9b3de-2496-4a20-92a0-5c60f8156756 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:23.454516 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-88c9b3de-2496-4a20-92a0-5c60f8156756 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:23.455352 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-88c9b3de-2496-4a20-92a0-5c60f8156756 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:23.456090 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-88c9b3de-2496-4a20-92a0-5c60f8156756 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:23.457044 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-88c9b3de-2496-4a20-92a0-5c60f8156756 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:23.457724 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-88c9b3de-2496-4a20-92a0-5c60f8156756 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:23.458376 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-88c9b3de-2496-4a20-92a0-5c60f8156756 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:23.748506 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-507fbfe9-8e9f-449a-a9c1-0513da01dabf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:23.767391 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-88c9b3de-2496-4a20-92a0-5c60f8156756 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:23.771752 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-507fbfe9-8e9f-449a-a9c1-0513da01dabf tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1653 microversion: 2.1 time: 0.394333 Aug 24 17:53:23.772401 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 327/655] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:23 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1653 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:23.778821 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-88c9b3de-2496-4a20-92a0-5c60f8156756 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1363 microversion: 2.1 time: 0.338609 Aug 24 17:53:23.780921 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 329/656] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:23 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1363 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:23.783036 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-61f3a49d-05f6-4f11-b7d3-49b60b2e2cf1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:23.783665 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-61f3a49d-05f6-4f11-b7d3-49b60b2e2cf1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:23.786873 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-fb8a6fe3-64d3-41eb-9325-3095f1140d29 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:23.792436 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-fb8a6fe3-64d3-41eb-9325-3095f1140d29 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:23.792580 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61f3a49d-05f6-4f11-b7d3-49b60b2e2cf1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:23.792580 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61f3a49d-05f6-4f11-b7d3-49b60b2e2cf1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:23.792580 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61f3a49d-05f6-4f11-b7d3-49b60b2e2cf1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:23.793171 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61f3a49d-05f6-4f11-b7d3-49b60b2e2cf1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:23.793630 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61f3a49d-05f6-4f11-b7d3-49b60b2e2cf1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:23.794370 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61f3a49d-05f6-4f11-b7d3-49b60b2e2cf1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:23.796445 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fb8a6fe3-64d3-41eb-9325-3095f1140d29 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:23.797276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fb8a6fe3-64d3-41eb-9325-3095f1140d29 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:23.797872 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fb8a6fe3-64d3-41eb-9325-3095f1140d29 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:23.798760 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fb8a6fe3-64d3-41eb-9325-3095f1140d29 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:23.799515 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fb8a6fe3-64d3-41eb-9325-3095f1140d29 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:23.800092 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fb8a6fe3-64d3-41eb-9325-3095f1140d29 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:24.113471 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-fb8a6fe3-64d3-41eb-9325-3095f1140d29 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:24.131986 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-fb8a6fe3-64d3-41eb-9325-3095f1140d29 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1314 microversion: 2.1 time: 0.349792 Aug 24 17:53:24.140096 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-61f3a49d-05f6-4f11-b7d3-49b60b2e2cf1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:24.140289 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 330/657] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:23 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:24.145322 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-61f3a49d-05f6-4f11-b7d3-49b60b2e2cf1 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 200 len: 1319 microversion: 2.1 time: 0.366489 Aug 24 17:53:24.146121 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-9411d8b8-3098-4c20-ab0b-4a9a34390033 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:24.155254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 328/658] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:23 2022] GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:24.162896 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9411d8b8-3098-4c20-ab0b-4a9a34390033 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:24.169467 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9411d8b8-3098-4c20-ab0b-4a9a34390033 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:24.170231 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9411d8b8-3098-4c20-ab0b-4a9a34390033 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:24.243669 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-9411d8b8-3098-4c20-ab0b-4a9a34390033 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Going to try to start instance {{(pid=127676) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 17:53:24.467598 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-9411d8b8-3098-4c20-ab0b-4a9a34390033 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "POST /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f/action" status: 202 len: 0 microversion: 2.1 time: 0.329816 Aug 24 17:53:24.468722 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 331/659] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 17:53:24 2022] POST /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:53:24.479426 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-fee98351-f8c5-401b-8d99-ad32c33b979d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:24.480720 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-fee98351-f8c5-401b-8d99-ad32c33b979d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:24.488037 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fee98351-f8c5-401b-8d99-ad32c33b979d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:24.488535 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fee98351-f8c5-401b-8d99-ad32c33b979d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:24.488976 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fee98351-f8c5-401b-8d99-ad32c33b979d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:24.489801 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fee98351-f8c5-401b-8d99-ad32c33b979d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:24.490366 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fee98351-f8c5-401b-8d99-ad32c33b979d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:24.490843 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fee98351-f8c5-401b-8d99-ad32c33b979d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:24.786059 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-fee98351-f8c5-401b-8d99-ad32c33b979d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:24.802201 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-fee98351-f8c5-401b-8d99-ad32c33b979d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1662 microversion: 2.1 time: 0.327010 Aug 24 17:53:24.826865 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ec289773-70db-4ba8-bf8e-3365c941f21e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:24.827059 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-ec289773-70db-4ba8-bf8e-3365c941f21e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:24.830496 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 329/660] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:24 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1662 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:24.834044 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ec289773-70db-4ba8-bf8e-3365c941f21e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:24.834827 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ec289773-70db-4ba8-bf8e-3365c941f21e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:24.835282 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ec289773-70db-4ba8-bf8e-3365c941f21e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:24.836133 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ec289773-70db-4ba8-bf8e-3365c941f21e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:24.836781 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ec289773-70db-4ba8-bf8e-3365c941f21e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:24.837418 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ec289773-70db-4ba8-bf8e-3365c941f21e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:25.005197 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-ec289773-70db-4ba8-bf8e-3365c941f21e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:25.016057 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-ec289773-70db-4ba8-bf8e-3365c941f21e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1363 microversion: 2.1 time: 0.195039 Aug 24 17:53:25.027021 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 332/661] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:24 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:25.111889 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-e63ed836-dffd-46a7-bbb3-fac8550f0827 req-a7698590-8f68-4aee-b094-db486c983a78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4c5b83-10ba-4343-a209-f00a509aa20f", "tag": "df84b545-e21e-40dc-a01c-73704d9d9f09"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:25.127183 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-e63ed836-dffd-46a7-bbb3-fac8550f0827 req-a7698590-8f68-4aee-b094-db486c983a78 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:25.128118 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-e63ed836-dffd-46a7-bbb3-fac8550f0827 req-a7698590-8f68-4aee-b094-db486c983a78 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:25.128779 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-e63ed836-dffd-46a7-bbb3-fac8550f0827 req-a7698590-8f68-4aee-b094-db486c983a78 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:25.149280 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-e63ed836-dffd-46a7-bbb3-fac8550f0827 req-a7698590-8f68-4aee-b094-db486c983a78 service nova] Creating event network-changed:df84b545-e21e-40dc-a01c-73704d9d9f09 for instance ea4c5b83-10ba-4343-a209-f00a509aa20f on hv-cinder-85442 Aug 24 17:53:25.162139 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-e63ed836-dffd-46a7-bbb3-fac8550f0827 req-a7698590-8f68-4aee-b094-db486c983a78 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056347 Aug 24 17:53:25.163383 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 330/662] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:25.164181 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-fcf8f53b-092e-4a5d-9475-fa5f3449e89f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:25.169387 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-fcf8f53b-092e-4a5d-9475-fa5f3449e89f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:25.190969 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fcf8f53b-092e-4a5d-9475-fa5f3449e89f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:25.192127 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fcf8f53b-092e-4a5d-9475-fa5f3449e89f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:25.192727 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fcf8f53b-092e-4a5d-9475-fa5f3449e89f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:25.193585 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1f268e3a-f1f2-4684-baf3-02f36f1ef51d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:25.193944 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fcf8f53b-092e-4a5d-9475-fa5f3449e89f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:25.194861 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fcf8f53b-092e-4a5d-9475-fa5f3449e89f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:25.195457 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1f268e3a-f1f2-4684-baf3-02f36f1ef51d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:25.196072 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fcf8f53b-092e-4a5d-9475-fa5f3449e89f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:25.209818 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1f268e3a-f1f2-4684-baf3-02f36f1ef51d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:25.212924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1f268e3a-f1f2-4684-baf3-02f36f1ef51d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:25.216050 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1f268e3a-f1f2-4684-baf3-02f36f1ef51d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:25.218539 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1f268e3a-f1f2-4684-baf3-02f36f1ef51d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:25.219803 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1f268e3a-f1f2-4684-baf3-02f36f1ef51d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:25.220587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1f268e3a-f1f2-4684-baf3-02f36f1ef51d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:25.593402 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-fcf8f53b-092e-4a5d-9475-fa5f3449e89f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:25.608900 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-fcf8f53b-092e-4a5d-9475-fa5f3449e89f tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1314 microversion: 2.1 time: 0.455383 Aug 24 17:53:25.625924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 333/663] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:25 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:25.629940 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-6277683c-8c2c-4aa1-b78c-58c2c369ee91 req-4beb1078-92a0-4c85-b86e-042f668cd2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04727389-f440-431a-83b1-12243a4dcfde", "tag": "4e6bc539-f420-470c-b1db-ab601c29c5a5"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:25.653579 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-6277683c-8c2c-4aa1-b78c-58c2c369ee91 req-4beb1078-92a0-4c85-b86e-042f668cd2c9 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:25.659256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-6277683c-8c2c-4aa1-b78c-58c2c369ee91 req-4beb1078-92a0-4c85-b86e-042f668cd2c9 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:25.659256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-6277683c-8c2c-4aa1-b78c-58c2c369ee91 req-4beb1078-92a0-4c85-b86e-042f668cd2c9 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:25.668731 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1f268e3a-f1f2-4684-baf3-02f36f1ef51d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:25.681512 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1f268e3a-f1f2-4684-baf3-02f36f1ef51d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 200 len: 1319 microversion: 2.1 time: 0.497193 Aug 24 17:53:25.684644 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 331/664] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:25 2022] GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 1319 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:25.689576 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-3ed3a077-c661-4dad-9456-8d08756bd724 req-c004c053-8c9b-4dc4-82da-56788ed6d607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a6ce1f4-195d-4f47-aa97-ca63353379cc", "name": "network-vif-plugged", "status": "completed", "tag": "8da2ef24-6418-47bd-9b86-9b7fbc7181f5"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:25.690132 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-6277683c-8c2c-4aa1-b78c-58c2c369ee91 req-4beb1078-92a0-4c85-b86e-042f668cd2c9 service nova] Creating event network-changed:4e6bc539-f420-470c-b1db-ab601c29c5a5 for instance 04727389-f440-431a-83b1-12243a4dcfde on hv-cinder-85442 Aug 24 17:53:25.700807 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-6277683c-8c2c-4aa1-b78c-58c2c369ee91 req-4beb1078-92a0-4c85-b86e-042f668cd2c9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076988 Aug 24 17:53:25.701592 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 334/665] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:25.703516 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-3ed3a077-c661-4dad-9456-8d08756bd724 req-c004c053-8c9b-4dc4-82da-56788ed6d607 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:25.703999 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-3ed3a077-c661-4dad-9456-8d08756bd724 req-c004c053-8c9b-4dc4-82da-56788ed6d607 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:25.704624 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-3ed3a077-c661-4dad-9456-8d08756bd724 req-c004c053-8c9b-4dc4-82da-56788ed6d607 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:25.721138 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-3ed3a077-c661-4dad-9456-8d08756bd724 req-c004c053-8c9b-4dc4-82da-56788ed6d607 service nova] Creating event network-vif-plugged:8da2ef24-6418-47bd-9b86-9b7fbc7181f5 for instance 5a6ce1f4-195d-4f47-aa97-ca63353379cc on hv-cinder-85442 Aug 24 17:53:25.726972 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-3ed3a077-c661-4dad-9456-8d08756bd724 req-c004c053-8c9b-4dc4-82da-56788ed6d607 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041528 Aug 24 17:53:25.730607 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 332/666] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:25.829509 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0c5b6268-afbf-4408-b248-f981f072b171 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:25.830362 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0c5b6268-afbf-4408-b248-f981f072b171 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:25.846439 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c5b6268-afbf-4408-b248-f981f072b171 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:25.847415 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c5b6268-afbf-4408-b248-f981f072b171 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:25.848580 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c5b6268-afbf-4408-b248-f981f072b171 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:25.850078 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c5b6268-afbf-4408-b248-f981f072b171 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:25.851316 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c5b6268-afbf-4408-b248-f981f072b171 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:25.852463 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c5b6268-afbf-4408-b248-f981f072b171 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:26.049687 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0900219a-9744-456f-bae8-42e3980b01ad tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:26.050723 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0900219a-9744-456f-bae8-42e3980b01ad tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:26.070106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0900219a-9744-456f-bae8-42e3980b01ad tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:26.074502 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0900219a-9744-456f-bae8-42e3980b01ad tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:26.076819 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0900219a-9744-456f-bae8-42e3980b01ad tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:26.079270 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0900219a-9744-456f-bae8-42e3980b01ad tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:26.080804 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0900219a-9744-456f-bae8-42e3980b01ad tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:26.081363 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0900219a-9744-456f-bae8-42e3980b01ad tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:26.269803 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0c5b6268-afbf-4408-b248-f981f072b171 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:26.282327 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0c5b6268-afbf-4408-b248-f981f072b171 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1662 microversion: 2.1 time: 0.458369 Aug 24 17:53:26.285228 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 335/667] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:25 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1662 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:26.365895 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0900219a-9744-456f-bae8-42e3980b01ad tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:26.375643 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0900219a-9744-456f-bae8-42e3980b01ad tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1363 microversion: 2.1 time: 0.330455 Aug 24 17:53:26.376391 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 333/668] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:26 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:26.646214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-80ae390b-0a9c-4794-94a7-71f730a31a33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:26.646798 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-80ae390b-0a9c-4794-94a7-71f730a31a33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:26.654287 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-80ae390b-0a9c-4794-94a7-71f730a31a33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:26.654781 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-80ae390b-0a9c-4794-94a7-71f730a31a33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:26.655208 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-80ae390b-0a9c-4794-94a7-71f730a31a33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:26.655908 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-80ae390b-0a9c-4794-94a7-71f730a31a33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:26.656355 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-80ae390b-0a9c-4794-94a7-71f730a31a33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:26.656775 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-80ae390b-0a9c-4794-94a7-71f730a31a33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:26.718758 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3c8d23b9-efa7-4dbf-8886-64676f61b745 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:26.719447 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3c8d23b9-efa7-4dbf-8886-64676f61b745 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:26.726033 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c8d23b9-efa7-4dbf-8886-64676f61b745 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:26.726805 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c8d23b9-efa7-4dbf-8886-64676f61b745 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:26.727408 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c8d23b9-efa7-4dbf-8886-64676f61b745 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:26.729409 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c8d23b9-efa7-4dbf-8886-64676f61b745 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:26.730093 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c8d23b9-efa7-4dbf-8886-64676f61b745 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:26.730824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c8d23b9-efa7-4dbf-8886-64676f61b745 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.208271 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-80ae390b-0a9c-4794-94a7-71f730a31a33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:27.216446 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-80ae390b-0a9c-4794-94a7-71f730a31a33 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1314 microversion: 2.1 time: 0.574191 Aug 24 17:53:27.217104 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 336/669] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:26 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:27.260554 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3c8d23b9-efa7-4dbf-8886-64676f61b745 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:27.268385 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3c8d23b9-efa7-4dbf-8886-64676f61b745 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 200 len: 1319 microversion: 2.1 time: 0.553732 Aug 24 17:53:27.268988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 334/670] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:26 2022] GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 1319 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:27.307513 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-49a8f1b0-4e94-4fdc-b4e2-f57bf35a34eb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:27.308134 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-49a8f1b0-4e94-4fdc-b4e2-f57bf35a34eb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:27.315477 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49a8f1b0-4e94-4fdc-b4e2-f57bf35a34eb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:27.316325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49a8f1b0-4e94-4fdc-b4e2-f57bf35a34eb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:27.317138 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49a8f1b0-4e94-4fdc-b4e2-f57bf35a34eb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.318352 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49a8f1b0-4e94-4fdc-b4e2-f57bf35a34eb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:27.319148 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49a8f1b0-4e94-4fdc-b4e2-f57bf35a34eb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:27.319892 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49a8f1b0-4e94-4fdc-b4e2-f57bf35a34eb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.400269 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0602d0a1-9c3d-44a9-8fb6-a158ee2c40f4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:27.401074 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0602d0a1-9c3d-44a9-8fb6-a158ee2c40f4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:27.407113 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0602d0a1-9c3d-44a9-8fb6-a158ee2c40f4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:27.407593 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0602d0a1-9c3d-44a9-8fb6-a158ee2c40f4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:27.408352 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0602d0a1-9c3d-44a9-8fb6-a158ee2c40f4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.409060 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0602d0a1-9c3d-44a9-8fb6-a158ee2c40f4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:27.409499 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0602d0a1-9c3d-44a9-8fb6-a158ee2c40f4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:27.409954 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0602d0a1-9c3d-44a9-8fb6-a158ee2c40f4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.507214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-49a8f1b0-4e94-4fdc-b4e2-f57bf35a34eb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:27.516994 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-49a8f1b0-4e94-4fdc-b4e2-f57bf35a34eb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1666 microversion: 2.1 time: 0.214502 Aug 24 17:53:27.518035 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 337/671] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:27 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1666 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:27.528846 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-07d59926-c490-4f9c-bffd-841468a593d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:27.529343 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-07d59926-c490-4f9c-bffd-841468a593d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:27.536058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-07d59926-c490-4f9c-bffd-841468a593d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:27.536554 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-07d59926-c490-4f9c-bffd-841468a593d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:27.536994 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-07d59926-c490-4f9c-bffd-841468a593d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.537735 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-07d59926-c490-4f9c-bffd-841468a593d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:27.538240 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-07d59926-c490-4f9c-bffd-841468a593d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:27.538670 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-07d59926-c490-4f9c-bffd-841468a593d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.578436 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-07d59926-c490-4f9c-bffd-841468a593d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/os-volume_attachments/9be66cc3-25d6-415b-8b26-49cf9aa63b59" status: 200 len: 194 microversion: 2.20 time: 0.053834 Aug 24 17:53:27.579108 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 338/672] 10.222.0.76 () {60 vars in 1454 bytes} [Wed Aug 24 17:53:27 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/os-volume_attachments/9be66cc3-25d6-415b-8b26-49cf9aa63b59 => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:53:27.590916 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0602d0a1-9c3d-44a9-8fb6-a158ee2c40f4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:27.599298 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0602d0a1-9c3d-44a9-8fb6-a158ee2c40f4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1363 microversion: 2.1 time: 0.206543 Aug 24 17:53:27.600213 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 335/673] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:27 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:27.654705 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-da694192-7f0d-46d0-bde4-bade012e3f1e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:27.655616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-da694192-7f0d-46d0-bde4-bade012e3f1e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:27.667056 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-da694192-7f0d-46d0-bde4-bade012e3f1e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:27.667897 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-da694192-7f0d-46d0-bde4-bade012e3f1e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:27.668674 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-da694192-7f0d-46d0-bde4-bade012e3f1e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.669942 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-da694192-7f0d-46d0-bde4-bade012e3f1e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:27.670814 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-da694192-7f0d-46d0-bde4-bade012e3f1e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:27.671291 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-da694192-7f0d-46d0-bde4-bade012e3f1e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.764941 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-da694192-7f0d-46d0-bde4-bade012e3f1e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lazy-loading 'services' on Instance uuid 154f9aac-b081-4041-ba41-dd14fb267e29 {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:53:28.078634 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-da694192-7f0d-46d0-bde4-bade012e3f1e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "DELETE /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/os-volume_attachments/9be66cc3-25d6-415b-8b26-49cf9aa63b59" status: 202 len: 0 microversion: 2.20 time: 0.431148 Aug 24 17:53:28.079184 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 339/674] 10.222.0.76 () {60 vars in 1457 bytes} [Wed Aug 24 17:53:27 2022] DELETE /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/os-volume_attachments/9be66cc3-25d6-415b-8b26-49cf9aa63b59 => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:53:28.088373 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-118cb843-aca3-4e60-8b5a-5e9d821a88c0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:28.090782 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-118cb843-aca3-4e60-8b5a-5e9d821a88c0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:28.097879 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-118cb843-aca3-4e60-8b5a-5e9d821a88c0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:28.098380 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-118cb843-aca3-4e60-8b5a-5e9d821a88c0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:28.099013 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-118cb843-aca3-4e60-8b5a-5e9d821a88c0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:28.099737 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-118cb843-aca3-4e60-8b5a-5e9d821a88c0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:28.100201 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-118cb843-aca3-4e60-8b5a-5e9d821a88c0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:28.100632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-118cb843-aca3-4e60-8b5a-5e9d821a88c0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:28.136633 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-118cb843-aca3-4e60-8b5a-5e9d821a88c0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052401 Aug 24 17:53:28.137237 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 336/675] 10.222.0.76 () {60 vars in 1343 bytes} [Wed Aug 24 17:53:28 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:53:28.237256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-681ba776-4b0d-4673-94cf-2928593895cc tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:28.238130 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-681ba776-4b0d-4673-94cf-2928593895cc tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:28.244947 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-681ba776-4b0d-4673-94cf-2928593895cc tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:28.245443 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-681ba776-4b0d-4673-94cf-2928593895cc tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:28.245996 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-681ba776-4b0d-4673-94cf-2928593895cc tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:28.246733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-681ba776-4b0d-4673-94cf-2928593895cc tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:28.247469 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-681ba776-4b0d-4673-94cf-2928593895cc tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:28.247826 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-681ba776-4b0d-4673-94cf-2928593895cc tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:28.267620 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:28.292320 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-95873009-5bce-4666-9bb6-d827b22a54dd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:28.292981 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-95873009-5bce-4666-9bb6-d827b22a54dd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:28.299693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-95873009-5bce-4666-9bb6-d827b22a54dd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:28.305717 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-95873009-5bce-4666-9bb6-d827b22a54dd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:28.305717 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-95873009-5bce-4666-9bb6-d827b22a54dd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:28.305717 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-95873009-5bce-4666-9bb6-d827b22a54dd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:28.305717 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-95873009-5bce-4666-9bb6-d827b22a54dd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:28.306939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-95873009-5bce-4666-9bb6-d827b22a54dd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:28.450138 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-681ba776-4b0d-4673-94cf-2928593895cc tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:28.458722 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-681ba776-4b0d-4673-94cf-2928593895cc tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1314 microversion: 2.1 time: 0.225635 Aug 24 17:53:28.459321 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 340/676] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:28 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:28.501932 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-95873009-5bce-4666-9bb6-d827b22a54dd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:28.510471 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-95873009-5bce-4666-9bb6-d827b22a54dd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 200 len: 1319 microversion: 2.1 time: 0.223515 Aug 24 17:53:28.511172 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 337/677] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:28 2022] GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:28.622264 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-744af54c-8c91-4350-9247-1a085d74d9f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:28.622782 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-744af54c-8c91-4350-9247-1a085d74d9f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:28.629212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-744af54c-8c91-4350-9247-1a085d74d9f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:28.629712 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-744af54c-8c91-4350-9247-1a085d74d9f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:28.630182 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-744af54c-8c91-4350-9247-1a085d74d9f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:28.630897 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-744af54c-8c91-4350-9247-1a085d74d9f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:28.631369 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-744af54c-8c91-4350-9247-1a085d74d9f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:28.631796 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-744af54c-8c91-4350-9247-1a085d74d9f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:28.785344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-744af54c-8c91-4350-9247-1a085d74d9f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:28.799357 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-744af54c-8c91-4350-9247-1a085d74d9f6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1363 microversion: 2.1 time: 0.181509 Aug 24 17:53:28.803710 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 341/678] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:28 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:29.153127 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-464aa433-729a-4e42-8e11-b8058d04f49b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:29.155366 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-464aa433-729a-4e42-8e11-b8058d04f49b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:29.162169 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-464aa433-729a-4e42-8e11-b8058d04f49b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:29.162670 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-464aa433-729a-4e42-8e11-b8058d04f49b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:29.163114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-464aa433-729a-4e42-8e11-b8058d04f49b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:29.163856 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-464aa433-729a-4e42-8e11-b8058d04f49b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:29.164308 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-464aa433-729a-4e42-8e11-b8058d04f49b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:29.164821 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-464aa433-729a-4e42-8e11-b8058d04f49b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:29.198950 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-464aa433-729a-4e42-8e11-b8058d04f49b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049838 Aug 24 17:53:29.199449 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 338/679] 10.222.0.76 () {60 vars in 1343 bytes} [Wed Aug 24 17:53:29 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:53:29.486556 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-4e16eb27-cb64-48cf-83a7-bb3217415c81 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:29.487704 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4e16eb27-cb64-48cf-83a7-bb3217415c81 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:29.499381 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e16eb27-cb64-48cf-83a7-bb3217415c81 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:29.500346 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e16eb27-cb64-48cf-83a7-bb3217415c81 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:29.500994 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e16eb27-cb64-48cf-83a7-bb3217415c81 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:29.502262 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e16eb27-cb64-48cf-83a7-bb3217415c81 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:29.502906 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e16eb27-cb64-48cf-83a7-bb3217415c81 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:29.503581 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4e16eb27-cb64-48cf-83a7-bb3217415c81 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:29.531723 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-6045d255-becc-4f27-8d24-a25397fd2c5c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:29.532403 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-6045d255-becc-4f27-8d24-a25397fd2c5c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:29.534510 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=2 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:29.541367 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6045d255-becc-4f27-8d24-a25397fd2c5c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:29.541881 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6045d255-becc-4f27-8d24-a25397fd2c5c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:29.542412 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6045d255-becc-4f27-8d24-a25397fd2c5c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:29.543256 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6045d255-becc-4f27-8d24-a25397fd2c5c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:29.543910 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6045d255-becc-4f27-8d24-a25397fd2c5c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:29.544536 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6045d255-becc-4f27-8d24-a25397fd2c5c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:29.747660 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-4e16eb27-cb64-48cf-83a7-bb3217415c81 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:29.750420 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-6045d255-becc-4f27-8d24-a25397fd2c5c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:29.754265 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=100 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:29.758482 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=2 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:29.759719 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-6045d255-becc-4f27-8d24-a25397fd2c5c tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 200 len: 1319 microversion: 2.1 time: 0.231310 Aug 24 17:53:29.760347 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 339/680] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:29 2022] GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:29.765083 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-4e16eb27-cb64-48cf-83a7-bb3217415c81 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1314 microversion: 2.1 time: 0.286163 Aug 24 17:53:29.766122 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 342/681] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:29 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:29.822653 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-69a980b5-282c-4447-981a-674fc157c52d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:29.823259 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-69a980b5-282c-4447-981a-674fc157c52d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:29.829311 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-69a980b5-282c-4447-981a-674fc157c52d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:29.829932 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-69a980b5-282c-4447-981a-674fc157c52d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:29.830380 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-69a980b5-282c-4447-981a-674fc157c52d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:29.831072 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-69a980b5-282c-4447-981a-674fc157c52d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:29.831520 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-69a980b5-282c-4447-981a-674fc157c52d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:29.831939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-69a980b5-282c-4447-981a-674fc157c52d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:29.975374 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-69a980b5-282c-4447-981a-674fc157c52d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:29.984244 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-69a980b5-282c-4447-981a-674fc157c52d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1363 microversion: 2.1 time: 0.165996 Aug 24 17:53:29.985148 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 340/682] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:29 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:30.215960 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-1795ab08-3e5b-4133-825e-81f78caef6a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:30.218475 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-1795ab08-3e5b-4133-825e-81f78caef6a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:30.220776 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=14 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:30.225771 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1795ab08-3e5b-4133-825e-81f78caef6a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.226301 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1795ab08-3e5b-4133-825e-81f78caef6a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.226831 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1795ab08-3e5b-4133-825e-81f78caef6a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:30.227471 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1795ab08-3e5b-4133-825e-81f78caef6a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.227931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1795ab08-3e5b-4133-825e-81f78caef6a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.228415 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1795ab08-3e5b-4133-825e-81f78caef6a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:30.263584 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-1795ab08-3e5b-4133-825e-81f78caef6a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054983 Aug 24 17:53:30.264164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 343/683] 10.222.0.76 () {60 vars in 1343 bytes} [Wed Aug 24 17:53:30 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:53:30.781645 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a29ea0c4-0843-434b-bc8e-25a53f761a6d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:30.782314 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a29ea0c4-0843-434b-bc8e-25a53f761a6d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:30.784291 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=8 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:30.790520 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a29ea0c4-0843-434b-bc8e-25a53f761a6d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.791021 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a29ea0c4-0843-434b-bc8e-25a53f761a6d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.791535 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a29ea0c4-0843-434b-bc8e-25a53f761a6d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:30.792371 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a29ea0c4-0843-434b-bc8e-25a53f761a6d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.792830 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a29ea0c4-0843-434b-bc8e-25a53f761a6d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.793269 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a29ea0c4-0843-434b-bc8e-25a53f761a6d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:30.801512 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-c0e3c2e1-6304-40f0-9058-75cc24df07d5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:30.802164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-c0e3c2e1-6304-40f0-9058-75cc24df07d5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:30.809108 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c0e3c2e1-6304-40f0-9058-75cc24df07d5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.809605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c0e3c2e1-6304-40f0-9058-75cc24df07d5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.810074 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c0e3c2e1-6304-40f0-9058-75cc24df07d5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:30.810787 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c0e3c2e1-6304-40f0-9058-75cc24df07d5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.811245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c0e3c2e1-6304-40f0-9058-75cc24df07d5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.811673 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c0e3c2e1-6304-40f0-9058-75cc24df07d5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:31.006586 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a29ea0c4-0843-434b-bc8e-25a53f761a6d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:31.015466 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a29ea0c4-0843-434b-bc8e-25a53f761a6d tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 200 len: 1319 microversion: 2.1 time: 0.237742 Aug 24 17:53:31.016281 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 341/684] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:30 2022] GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:31.021171 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a7eef85b-47e8-4cdc-94e2-8a8275fdef74 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:31.021684 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a7eef85b-47e8-4cdc-94e2-8a8275fdef74 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:31.029436 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a7eef85b-47e8-4cdc-94e2-8a8275fdef74 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:31.029944 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a7eef85b-47e8-4cdc-94e2-8a8275fdef74 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:31.030423 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a7eef85b-47e8-4cdc-94e2-8a8275fdef74 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:31.031120 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a7eef85b-47e8-4cdc-94e2-8a8275fdef74 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:31.031564 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a7eef85b-47e8-4cdc-94e2-8a8275fdef74 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:31.031992 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a7eef85b-47e8-4cdc-94e2-8a8275fdef74 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:31.035199 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c0e3c2e1-6304-40f0-9058-75cc24df07d5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:31.044246 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-c0e3c2e1-6304-40f0-9058-75cc24df07d5 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1498 microversion: 2.1 time: 0.246864 Aug 24 17:53:31.044993 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 344/685] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:30 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1498 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:31.226066 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a7eef85b-47e8-4cdc-94e2-8a8275fdef74 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:31.235460 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a7eef85b-47e8-4cdc-94e2-8a8275fdef74 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1363 microversion: 2.1 time: 0.217679 Aug 24 17:53:31.235460 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 342/686] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:31 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:31.277671 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5cfd4464-b47f-45dc-a890-28cfec99f416 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:31.279961 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5cfd4464-b47f-45dc-a890-28cfec99f416 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:31.287224 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5cfd4464-b47f-45dc-a890-28cfec99f416 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:31.291091 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5cfd4464-b47f-45dc-a890-28cfec99f416 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:31.291091 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5cfd4464-b47f-45dc-a890-28cfec99f416 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:31.291091 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5cfd4464-b47f-45dc-a890-28cfec99f416 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:31.291091 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5cfd4464-b47f-45dc-a890-28cfec99f416 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:31.291594 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5cfd4464-b47f-45dc-a890-28cfec99f416 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:31.326703 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5cfd4464-b47f-45dc-a890-28cfec99f416 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054224 Aug 24 17:53:31.327334 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 345/687] 10.222.0.76 () {60 vars in 1343 bytes} [Wed Aug 24 17:53:31 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:53:31.670407 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-848ac37b-1919-4a19-a505-20ac8e61fcf2 req-e17ada84-d815-44fa-975d-b6c85da0aa27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04727389-f440-431a-83b1-12243a4dcfde", "name": "network-vif-plugged", "status": "completed", "tag": "4e6bc539-f420-470c-b1db-ab601c29c5a5"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:31.684594 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-848ac37b-1919-4a19-a505-20ac8e61fcf2 req-e17ada84-d815-44fa-975d-b6c85da0aa27 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:31.685639 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-848ac37b-1919-4a19-a505-20ac8e61fcf2 req-e17ada84-d815-44fa-975d-b6c85da0aa27 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:31.686964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-848ac37b-1919-4a19-a505-20ac8e61fcf2 req-e17ada84-d815-44fa-975d-b6c85da0aa27 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:31.721676 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-848ac37b-1919-4a19-a505-20ac8e61fcf2 req-e17ada84-d815-44fa-975d-b6c85da0aa27 service nova] Creating event network-vif-plugged:4e6bc539-f420-470c-b1db-ab601c29c5a5 for instance 04727389-f440-431a-83b1-12243a4dcfde on hv-cinder-85442 Aug 24 17:53:31.731014 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-848ac37b-1919-4a19-a505-20ac8e61fcf2 req-e17ada84-d815-44fa-975d-b6c85da0aa27 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064791 Aug 24 17:53:31.732750 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 343/688] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:32.039319 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8a7d91f3-d89a-42fa-8938-9c7a35bca2fd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:32.040599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8a7d91f3-d89a-42fa-8938-9c7a35bca2fd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:32.051352 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8a7d91f3-d89a-42fa-8938-9c7a35bca2fd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:32.052196 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8a7d91f3-d89a-42fa-8938-9c7a35bca2fd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:32.053036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8a7d91f3-d89a-42fa-8938-9c7a35bca2fd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:32.053970 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8a7d91f3-d89a-42fa-8938-9c7a35bca2fd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:32.054586 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8a7d91f3-d89a-42fa-8938-9c7a35bca2fd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:32.055166 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8a7d91f3-d89a-42fa-8938-9c7a35bca2fd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:32.107168 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-cc1481d2-341e-4e60-a7b7-7ed4c79e6e71 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:32.107764 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-cc1481d2-341e-4e60-a7b7-7ed4c79e6e71 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:32.115842 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cc1481d2-341e-4e60-a7b7-7ed4c79e6e71 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:32.122034 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cc1481d2-341e-4e60-a7b7-7ed4c79e6e71 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:32.122034 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cc1481d2-341e-4e60-a7b7-7ed4c79e6e71 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:32.122034 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cc1481d2-341e-4e60-a7b7-7ed4c79e6e71 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:32.122034 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cc1481d2-341e-4e60-a7b7-7ed4c79e6e71 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:32.122624 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cc1481d2-341e-4e60-a7b7-7ed4c79e6e71 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:32.151831 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-cc1481d2-341e-4e60-a7b7-7ed4c79e6e71 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Going to try to terminate instance {{(pid=127677) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:53:32.289027 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8a7d91f3-d89a-42fa-8938-9c7a35bca2fd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:32.299296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-8a7d91f3-d89a-42fa-8938-9c7a35bca2fd tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 200 len: 1319 microversion: 2.1 time: 0.264567 Aug 24 17:53:32.313786 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 346/689] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:32 2022] GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:32.317733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-20645439-0e1b-4b4e-b35a-11d1050b0338 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:32.318384 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-20645439-0e1b-4b4e-b35a-11d1050b0338 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:32.324743 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-20645439-0e1b-4b4e-b35a-11d1050b0338 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:32.325222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-20645439-0e1b-4b4e-b35a-11d1050b0338 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:32.325685 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-20645439-0e1b-4b4e-b35a-11d1050b0338 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:32.326382 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-20645439-0e1b-4b4e-b35a-11d1050b0338 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:32.326918 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-20645439-0e1b-4b4e-b35a-11d1050b0338 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:32.327315 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-20645439-0e1b-4b4e-b35a-11d1050b0338 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:32.477280 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-20645439-0e1b-4b4e-b35a-11d1050b0338 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:32.486199 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-20645439-0e1b-4b4e-b35a-11d1050b0338 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1363 microversion: 2.1 time: 0.185230 Aug 24 17:53:32.490569 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 347/690] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:32 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:32.491605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-74695580-56cc-4ee7-b4ed-9f533af0adf6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:32.494506 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-74695580-56cc-4ee7-b4ed-9f533af0adf6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:32.500877 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-74695580-56cc-4ee7-b4ed-9f533af0adf6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:32.501390 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-74695580-56cc-4ee7-b4ed-9f533af0adf6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:32.501829 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-74695580-56cc-4ee7-b4ed-9f533af0adf6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:32.502567 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-74695580-56cc-4ee7-b4ed-9f533af0adf6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:32.503028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-74695580-56cc-4ee7-b4ed-9f533af0adf6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:32.503451 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-74695580-56cc-4ee7-b4ed-9f533af0adf6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:32.535887 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-74695580-56cc-4ee7-b4ed-9f533af0adf6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048010 Aug 24 17:53:32.536472 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 348/691] 10.222.0.76 () {60 vars in 1343 bytes} [Wed Aug 24 17:53:32 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:32.596521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-cc1481d2-341e-4e60-a7b7-7ed4c79e6e71 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 204 len: 0 microversion: 2.1 time: 0.493444 Aug 24 17:53:32.598785 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 344/692] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:53:32 2022] DELETE /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:53:32.606472 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-37083772-d3ed-4d7f-9c54-f4b8dafc3796 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:32.607097 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-37083772-d3ed-4d7f-9c54-f4b8dafc3796 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:32.613268 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-37083772-d3ed-4d7f-9c54-f4b8dafc3796 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:32.613715 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-37083772-d3ed-4d7f-9c54-f4b8dafc3796 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:32.614169 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-37083772-d3ed-4d7f-9c54-f4b8dafc3796 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:32.614868 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-37083772-d3ed-4d7f-9c54-f4b8dafc3796 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:32.615403 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-37083772-d3ed-4d7f-9c54-f4b8dafc3796 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:32.615524 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0a7dff42-ec9c-4b9b-a91d-d8a5a64c3f61 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:32.615744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-37083772-d3ed-4d7f-9c54-f4b8dafc3796 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:32.617132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0a7dff42-ec9c-4b9b-a91d-d8a5a64c3f61 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:32.624651 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0a7dff42-ec9c-4b9b-a91d-d8a5a64c3f61 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:32.625137 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0a7dff42-ec9c-4b9b-a91d-d8a5a64c3f61 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:32.625570 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0a7dff42-ec9c-4b9b-a91d-d8a5a64c3f61 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:32.626305 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0a7dff42-ec9c-4b9b-a91d-d8a5a64c3f61 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:32.626756 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0a7dff42-ec9c-4b9b-a91d-d8a5a64c3f61 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:32.627178 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0a7dff42-ec9c-4b9b-a91d-d8a5a64c3f61 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:32.657907 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0a7dff42-ec9c-4b9b-a91d-d8a5a64c3f61 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Going to try to terminate instance {{(pid=127677) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:53:32.790358 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-37083772-d3ed-4d7f-9c54-f4b8dafc3796 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:32.799318 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-37083772-d3ed-4d7f-9c54-f4b8dafc3796 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1504 microversion: 2.1 time: 0.197317 Aug 24 17:53:32.799914 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 349/693] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:32 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1504 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:33.116530 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0a7dff42-ec9c-4b9b-a91d-d8a5a64c3f61 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "DELETE /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 204 len: 0 microversion: 2.20 time: 0.508359 Aug 24 17:53:33.117303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 345/694] 10.222.0.76 () {60 vars in 1280 bytes} [Wed Aug 24 17:53:32 2022] DELETE /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 17:53:33.127198 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e5754d35-82fa-4b01-81b7-a40d25a1bdd7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:33.127913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e5754d35-82fa-4b01-81b7-a40d25a1bdd7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:33.136365 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e5754d35-82fa-4b01-81b7-a40d25a1bdd7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:33.137080 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e5754d35-82fa-4b01-81b7-a40d25a1bdd7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:33.137337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e5754d35-82fa-4b01-81b7-a40d25a1bdd7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:33.138096 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e5754d35-82fa-4b01-81b7-a40d25a1bdd7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:33.138549 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e5754d35-82fa-4b01-81b7-a40d25a1bdd7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:33.138978 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e5754d35-82fa-4b01-81b7-a40d25a1bdd7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:33.321326 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-2563729f-abd9-4595-998c-a06a8979c3fc tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:33.322086 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-2563729f-abd9-4595-998c-a06a8979c3fc tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:33.329897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2563729f-abd9-4595-998c-a06a8979c3fc tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:33.329897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2563729f-abd9-4595-998c-a06a8979c3fc tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:33.329897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2563729f-abd9-4595-998c-a06a8979c3fc tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:33.330444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2563729f-abd9-4595-998c-a06a8979c3fc tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:33.330767 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2563729f-abd9-4595-998c-a06a8979c3fc tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:33.331187 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2563729f-abd9-4595-998c-a06a8979c3fc tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:33.337908 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e5754d35-82fa-4b01-81b7-a40d25a1bdd7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:33.346683 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e5754d35-82fa-4b01-81b7-a40d25a1bdd7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:33.348189 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e5754d35-82fa-4b01-81b7-a40d25a1bdd7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:33.349368 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e5754d35-82fa-4b01-81b7-a40d25a1bdd7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.226818 Aug 24 17:53:33.350065 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 350/695] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:33 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:53:33.499378 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-2563729f-abd9-4595-998c-a06a8979c3fc tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:33.512800 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e002e97d-e611-4c53-92a7-eef1d786863b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:33.513128 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-2563729f-abd9-4595-998c-a06a8979c3fc tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 200 len: 1319 microversion: 2.1 time: 0.195206 Aug 24 17:53:33.520584 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 346/696] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:33 2022] GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:33.520863 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e002e97d-e611-4c53-92a7-eef1d786863b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:33.536159 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e002e97d-e611-4c53-92a7-eef1d786863b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:33.538606 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e002e97d-e611-4c53-92a7-eef1d786863b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:33.541052 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e002e97d-e611-4c53-92a7-eef1d786863b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:33.542499 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e002e97d-e611-4c53-92a7-eef1d786863b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:33.543465 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e002e97d-e611-4c53-92a7-eef1d786863b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:33.544407 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e002e97d-e611-4c53-92a7-eef1d786863b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:33.724860 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e002e97d-e611-4c53-92a7-eef1d786863b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:33.724860 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e002e97d-e611-4c53-92a7-eef1d786863b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1363 microversion: 2.1 time: 0.210104 Aug 24 17:53:33.724860 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 351/697] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:33 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:33.749377 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-afbe5813-be31-4761-9aa5-0fa7c8923c0e req-e614dd22-0fca-4294-9dcf-d0fdc76ae0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4c5b83-10ba-4343-a209-f00a509aa20f", "name": "network-vif-plugged", "status": "completed", "tag": "df84b545-e21e-40dc-a01c-73704d9d9f09"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:33.760521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-afbe5813-be31-4761-9aa5-0fa7c8923c0e req-e614dd22-0fca-4294-9dcf-d0fdc76ae0d7 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:33.761003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-afbe5813-be31-4761-9aa5-0fa7c8923c0e req-e614dd22-0fca-4294-9dcf-d0fdc76ae0d7 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:33.761445 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-afbe5813-be31-4761-9aa5-0fa7c8923c0e req-e614dd22-0fca-4294-9dcf-d0fdc76ae0d7 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:33.773692 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-afbe5813-be31-4761-9aa5-0fa7c8923c0e req-e614dd22-0fca-4294-9dcf-d0fdc76ae0d7 service nova] Creating event network-vif-plugged:df84b545-e21e-40dc-a01c-73704d9d9f09 for instance ea4c5b83-10ba-4343-a209-f00a509aa20f on hv-cinder-85442 Aug 24 17:53:33.779412 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-afbe5813-be31-4761-9aa5-0fa7c8923c0e req-e614dd22-0fca-4294-9dcf-d0fdc76ae0d7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033828 Aug 24 17:53:33.783508 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 347/698] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:33.820895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-c9c3070a-e6ca-4be7-b77d-fae2bed50b85 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:33.822460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-c9c3070a-e6ca-4be7-b77d-fae2bed50b85 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:33.824446 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:33.829484 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c9c3070a-e6ca-4be7-b77d-fae2bed50b85 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:33.830012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c9c3070a-e6ca-4be7-b77d-fae2bed50b85 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:33.830473 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c9c3070a-e6ca-4be7-b77d-fae2bed50b85 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:33.831180 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c9c3070a-e6ca-4be7-b77d-fae2bed50b85 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:33.831599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c9c3070a-e6ca-4be7-b77d-fae2bed50b85 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:33.832023 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c9c3070a-e6ca-4be7-b77d-fae2bed50b85 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:33.982199 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c9c3070a-e6ca-4be7-b77d-fae2bed50b85 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:33.990203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-c9c3070a-e6ca-4be7-b77d-fae2bed50b85 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1504 microversion: 2.1 time: 0.173122 Aug 24 17:53:33.990783 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 352/699] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:33 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:34.375471 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-8a0862fe-6364-4379-9ee2-ecf0da7d5fb7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:34.376545 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-8a0862fe-6364-4379-9ee2-ecf0da7d5fb7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:34.385561 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8a0862fe-6364-4379-9ee2-ecf0da7d5fb7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:34.386097 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8a0862fe-6364-4379-9ee2-ecf0da7d5fb7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:34.386538 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8a0862fe-6364-4379-9ee2-ecf0da7d5fb7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:34.387242 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8a0862fe-6364-4379-9ee2-ecf0da7d5fb7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:34.387690 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8a0862fe-6364-4379-9ee2-ecf0da7d5fb7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:34.388109 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8a0862fe-6364-4379-9ee2-ecf0da7d5fb7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:34.532790 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-8a0862fe-6364-4379-9ee2-ecf0da7d5fb7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:34.541807 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-8a0862fe-6364-4379-9ee2-ecf0da7d5fb7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:34.544067 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-8a0862fe-6364-4379-9ee2-ecf0da7d5fb7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:34.545244 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-8a0862fe-6364-4379-9ee2-ecf0da7d5fb7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.174705 Aug 24 17:53:34.545796 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 348/700] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:34 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:34.548311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-6afc6d8c-ae78-4e6b-92b8-03ca3cbf30ba tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:34.557612 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-6afc6d8c-ae78-4e6b-92b8-03ca3cbf30ba tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:34.557612 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6afc6d8c-ae78-4e6b-92b8-03ca3cbf30ba tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:34.557612 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6afc6d8c-ae78-4e6b-92b8-03ca3cbf30ba tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:34.557612 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6afc6d8c-ae78-4e6b-92b8-03ca3cbf30ba tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:34.558165 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6afc6d8c-ae78-4e6b-92b8-03ca3cbf30ba tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:34.558165 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6afc6d8c-ae78-4e6b-92b8-03ca3cbf30ba tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:34.558337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6afc6d8c-ae78-4e6b-92b8-03ca3cbf30ba tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:34.702321 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-6afc6d8c-ae78-4e6b-92b8-03ca3cbf30ba tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:34.710354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-6afc6d8c-ae78-4e6b-92b8-03ca3cbf30ba tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 200 len: 1319 microversion: 2.1 time: 0.166312 Aug 24 17:53:34.710931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 353/701] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:34 2022] GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:34.740591 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-cc32ff57-a773-409e-9057-afc843f0c585 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:34.741805 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-cc32ff57-a773-409e-9057-afc843f0c585 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:34.753393 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cc32ff57-a773-409e-9057-afc843f0c585 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:34.754297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cc32ff57-a773-409e-9057-afc843f0c585 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:34.755074 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cc32ff57-a773-409e-9057-afc843f0c585 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:34.756280 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cc32ff57-a773-409e-9057-afc843f0c585 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:34.757097 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cc32ff57-a773-409e-9057-afc843f0c585 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:34.757881 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cc32ff57-a773-409e-9057-afc843f0c585 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:34.912144 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-cc32ff57-a773-409e-9057-afc843f0c585 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:34.921530 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-cc32ff57-a773-409e-9057-afc843f0c585 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1363 microversion: 2.1 time: 0.187987 Aug 24 17:53:34.926282 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 349/702] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:34 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:35.012855 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-bc75b332-704b-4877-8c18-a0ce9739381b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:35.013383 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-bc75b332-704b-4877-8c18-a0ce9739381b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:35.019475 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bc75b332-704b-4877-8c18-a0ce9739381b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:35.019963 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bc75b332-704b-4877-8c18-a0ce9739381b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:35.020401 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bc75b332-704b-4877-8c18-a0ce9739381b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:35.021349 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bc75b332-704b-4877-8c18-a0ce9739381b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:35.021816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bc75b332-704b-4877-8c18-a0ce9739381b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:35.022275 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bc75b332-704b-4877-8c18-a0ce9739381b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:35.163809 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-bc75b332-704b-4877-8c18-a0ce9739381b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:35.171695 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-bc75b332-704b-4877-8c18-a0ce9739381b tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1504 microversion: 2.1 time: 0.163478 Aug 24 17:53:35.172262 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 354/703] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:35 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:35.568961 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-55ad1fa9-968e-4a5b-946e-3398b107887d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:35.569585 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-55ad1fa9-968e-4a5b-946e-3398b107887d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:35.577346 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-55ad1fa9-968e-4a5b-946e-3398b107887d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:35.577901 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-55ad1fa9-968e-4a5b-946e-3398b107887d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:35.578400 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-55ad1fa9-968e-4a5b-946e-3398b107887d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:35.579392 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-55ad1fa9-968e-4a5b-946e-3398b107887d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:35.579904 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-55ad1fa9-968e-4a5b-946e-3398b107887d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:35.580378 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-55ad1fa9-968e-4a5b-946e-3398b107887d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:35.716812 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-55ad1fa9-968e-4a5b-946e-3398b107887d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:35.726541 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-55ad1fa9-968e-4a5b-946e-3398b107887d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:35.726711 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-55ad1fa9-968e-4a5b-946e-3398b107887d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:35.727740 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-55ad1fa9-968e-4a5b-946e-3398b107887d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.162808 Aug 24 17:53:35.728290 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 350/704] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:35 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:53:35.732397 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-3576b175-5191-4551-ada2-0cd5ebd71110 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:35.733013 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-3576b175-5191-4551-ada2-0cd5ebd71110 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:35.739478 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3576b175-5191-4551-ada2-0cd5ebd71110 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:35.739970 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3576b175-5191-4551-ada2-0cd5ebd71110 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:35.740406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3576b175-5191-4551-ada2-0cd5ebd71110 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:35.741092 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3576b175-5191-4551-ada2-0cd5ebd71110 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:35.741547 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3576b175-5191-4551-ada2-0cd5ebd71110 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:35.742008 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3576b175-5191-4551-ada2-0cd5ebd71110 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:35.876160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-3576b175-5191-4551-ada2-0cd5ebd71110 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:35.884049 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-3576b175-5191-4551-ada2-0cd5ebd71110 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 200 len: 1319 microversion: 2.1 time: 0.156051 Aug 24 17:53:35.884629 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 355/705] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:35 2022] GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:35.941612 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1fc8ba7c-54e2-48d0-aef6-c49fb44d3abb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:35.942251 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1fc8ba7c-54e2-48d0-aef6-c49fb44d3abb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:35.948485 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1fc8ba7c-54e2-48d0-aef6-c49fb44d3abb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:35.948970 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1fc8ba7c-54e2-48d0-aef6-c49fb44d3abb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:35.949409 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1fc8ba7c-54e2-48d0-aef6-c49fb44d3abb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:35.950125 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1fc8ba7c-54e2-48d0-aef6-c49fb44d3abb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:35.950582 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1fc8ba7c-54e2-48d0-aef6-c49fb44d3abb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:35.951007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1fc8ba7c-54e2-48d0-aef6-c49fb44d3abb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:36.089399 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1fc8ba7c-54e2-48d0-aef6-c49fb44d3abb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:36.097143 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1fc8ba7c-54e2-48d0-aef6-c49fb44d3abb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1363 microversion: 2.1 time: 0.159326 Aug 24 17:53:36.097712 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 351/706] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:35 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:36.193243 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-79aa248c-5c81-4998-bcd9-4fc61b4e23e4 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:36.194058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-79aa248c-5c81-4998-bcd9-4fc61b4e23e4 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:36.200046 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-79aa248c-5c81-4998-bcd9-4fc61b4e23e4 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:36.200534 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-79aa248c-5c81-4998-bcd9-4fc61b4e23e4 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:36.200976 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-79aa248c-5c81-4998-bcd9-4fc61b4e23e4 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:36.201765 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-79aa248c-5c81-4998-bcd9-4fc61b4e23e4 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:36.202258 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-79aa248c-5c81-4998-bcd9-4fc61b4e23e4 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:36.202686 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-79aa248c-5c81-4998-bcd9-4fc61b4e23e4 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:36.337055 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-79aa248c-5c81-4998-bcd9-4fc61b4e23e4 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:36.345361 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-79aa248c-5c81-4998-bcd9-4fc61b4e23e4 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1504 microversion: 2.1 time: 0.156168 Aug 24 17:53:36.345971 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 356/707] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:36 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:36.751697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1e200b14-26d5-4812-a67f-1bb61337a042 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:36.752290 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1e200b14-26d5-4812-a67f-1bb61337a042 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:36.758795 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1e200b14-26d5-4812-a67f-1bb61337a042 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:36.759275 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1e200b14-26d5-4812-a67f-1bb61337a042 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:36.759703 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1e200b14-26d5-4812-a67f-1bb61337a042 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:36.761060 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1e200b14-26d5-4812-a67f-1bb61337a042 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:36.761508 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1e200b14-26d5-4812-a67f-1bb61337a042 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:36.761956 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1e200b14-26d5-4812-a67f-1bb61337a042 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:36.900449 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1e200b14-26d5-4812-a67f-1bb61337a042 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:36.904699 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e52bb4db-cda9-4d2a-bc33-7917aeff25de tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:36.911203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e52bb4db-cda9-4d2a-bc33-7917aeff25de tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:36.911650 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1e200b14-26d5-4812-a67f-1bb61337a042 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:36.913368 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1e200b14-26d5-4812-a67f-1bb61337a042 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:36.915315 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1e200b14-26d5-4812-a67f-1bb61337a042 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1721 microversion: 2.20 time: 0.167380 Aug 24 17:53:36.915911 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 352/708] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:36 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:53:36.936863 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e52bb4db-cda9-4d2a-bc33-7917aeff25de tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:36.941659 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e52bb4db-cda9-4d2a-bc33-7917aeff25de tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:36.941659 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e52bb4db-cda9-4d2a-bc33-7917aeff25de tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:36.941659 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e52bb4db-cda9-4d2a-bc33-7917aeff25de tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:36.941659 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e52bb4db-cda9-4d2a-bc33-7917aeff25de tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:36.942032 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e52bb4db-cda9-4d2a-bc33-7917aeff25de tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:36.945000 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=100 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:37.119868 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-540df715-ce5d-4ec6-b283-9af813ebdd57 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:37.122129 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-540df715-ce5d-4ec6-b283-9af813ebdd57 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:37.129090 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-540df715-ce5d-4ec6-b283-9af813ebdd57 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:37.129587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-540df715-ce5d-4ec6-b283-9af813ebdd57 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:37.130077 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-540df715-ce5d-4ec6-b283-9af813ebdd57 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:37.130781 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-540df715-ce5d-4ec6-b283-9af813ebdd57 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:37.131240 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-540df715-ce5d-4ec6-b283-9af813ebdd57 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:37.131851 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-540df715-ce5d-4ec6-b283-9af813ebdd57 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:37.199823 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e52bb4db-cda9-4d2a-bc33-7917aeff25de tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:37.207991 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e52bb4db-cda9-4d2a-bc33-7917aeff25de tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 200 len: 1508 microversion: 2.1 time: 0.307339 Aug 24 17:53:37.208568 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 357/709] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:36 2022] GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 1508 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:37.231242 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d282f532-bd9b-439f-a213-3bf7240aa868 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de120c82-3e33-4691-b612-ba13c8dab3a3", "device": "/dev/sdb"}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:37.233293 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d282f532-bd9b-439f-a213-3bf7240aa868 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:37.239787 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d282f532-bd9b-439f-a213-3bf7240aa868 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:37.240274 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d282f532-bd9b-439f-a213-3bf7240aa868 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:37.240710 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d282f532-bd9b-439f-a213-3bf7240aa868 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:37.241422 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d282f532-bd9b-439f-a213-3bf7240aa868 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:37.241889 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d282f532-bd9b-439f-a213-3bf7240aa868 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:37.242316 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d282f532-bd9b-439f-a213-3bf7240aa868 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:37.359476 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-540df715-ce5d-4ec6-b283-9af813ebdd57 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:37.368711 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-540df715-ce5d-4ec6-b283-9af813ebdd57 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1363 microversion: 2.1 time: 0.253256 Aug 24 17:53:37.369827 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 353/710] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:37 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:37.388677 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-78ea3801-008c-4208-a7c4-f4d47be05b93 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:37.389652 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-78ea3801-008c-4208-a7c4-f4d47be05b93 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:37.396220 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-78ea3801-008c-4208-a7c4-f4d47be05b93 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:37.396799 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-78ea3801-008c-4208-a7c4-f4d47be05b93 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:37.397649 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-78ea3801-008c-4208-a7c4-f4d47be05b93 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:37.398554 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-78ea3801-008c-4208-a7c4-f4d47be05b93 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:37.399032 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-78ea3801-008c-4208-a7c4-f4d47be05b93 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:37.399364 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-78ea3801-008c-4208-a7c4-f4d47be05b93 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:37.421108 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:37.561543 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-78ea3801-008c-4208-a7c4-f4d47be05b93 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:37.569410 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-78ea3801-008c-4208-a7c4-f4d47be05b93 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1504 microversion: 2.1 time: 0.185261 Aug 24 17:53:37.570007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 354/711] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:37 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1504 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:37.575774 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-581e869b-e6c6-40e9-9081-ff3e2339ec0f req-0cdfca98-2a0a-4f10-b03f-f8f9c0ad4e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "154f9aac-b081-4041-ba41-dd14fb267e29", "name": "network-vif-unplugged", "status": "completed", "tag": "12033839-1050-4fb0-90d7-ede010ae619a"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:37.585403 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-581e869b-e6c6-40e9-9081-ff3e2339ec0f req-0cdfca98-2a0a-4f10-b03f-f8f9c0ad4e4c service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:37.585912 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-581e869b-e6c6-40e9-9081-ff3e2339ec0f req-0cdfca98-2a0a-4f10-b03f-f8f9c0ad4e4c service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:37.586466 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-581e869b-e6c6-40e9-9081-ff3e2339ec0f req-0cdfca98-2a0a-4f10-b03f-f8f9c0ad4e4c service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:37.599966 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-581e869b-e6c6-40e9-9081-ff3e2339ec0f req-0cdfca98-2a0a-4f10-b03f-f8f9c0ad4e4c service nova] Creating event network-vif-unplugged:12033839-1050-4fb0-90d7-ede010ae619a for instance 154f9aac-b081-4041-ba41-dd14fb267e29 on hv-cinder-85442 Aug 24 17:53:37.605565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-581e869b-e6c6-40e9-9081-ff3e2339ec0f req-0cdfca98-2a0a-4f10-b03f-f8f9c0ad4e4c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034290 Aug 24 17:53:37.606649 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 355/712] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:37.703471 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-fb52d4f1-1c6c-415f-bcc2-a69a76faca0d req-5afae2b2-eabc-471a-89fc-083e8db5f598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a6ce1f4-195d-4f47-aa97-ca63353379cc", "name": "network-vif-deleted", "tag": "8da2ef24-6418-47bd-9b86-9b7fbc7181f5"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:37.716512 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-fb52d4f1-1c6c-415f-bcc2-a69a76faca0d req-5afae2b2-eabc-471a-89fc-083e8db5f598 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:37.717026 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-fb52d4f1-1c6c-415f-bcc2-a69a76faca0d req-5afae2b2-eabc-471a-89fc-083e8db5f598 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:37.717475 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-fb52d4f1-1c6c-415f-bcc2-a69a76faca0d req-5afae2b2-eabc-471a-89fc-083e8db5f598 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:37.730159 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-fb52d4f1-1c6c-415f-bcc2-a69a76faca0d req-5afae2b2-eabc-471a-89fc-083e8db5f598 service nova] Creating event network-vif-deleted:8da2ef24-6418-47bd-9b86-9b7fbc7181f5 for instance 5a6ce1f4-195d-4f47-aa97-ca63353379cc on hv-cinder-85442 Aug 24 17:53:37.737278 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-fb52d4f1-1c6c-415f-bcc2-a69a76faca0d req-5afae2b2-eabc-471a-89fc-083e8db5f598 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037908 Aug 24 17:53:37.737910 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 356/713] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:37.941166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-30aeb8dc-1e0d-428c-a115-1e52ddb154a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:37.942201 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-30aeb8dc-1e0d-428c-a115-1e52ddb154a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:37.950081 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-30aeb8dc-1e0d-428c-a115-1e52ddb154a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:37.950566 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-30aeb8dc-1e0d-428c-a115-1e52ddb154a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:37.950997 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-30aeb8dc-1e0d-428c-a115-1e52ddb154a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:37.951685 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-30aeb8dc-1e0d-428c-a115-1e52ddb154a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:37.952174 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-30aeb8dc-1e0d-428c-a115-1e52ddb154a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:37.952586 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-30aeb8dc-1e0d-428c-a115-1e52ddb154a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:38.030568 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-30aeb8dc-1e0d-428c-a115-1e52ddb154a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:38.045977 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-30aeb8dc-1e0d-428c-a115-1e52ddb154a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:38.047419 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-30aeb8dc-1e0d-428c-a115-1e52ddb154a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:38.048822 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-30aeb8dc-1e0d-428c-a115-1e52ddb154a9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1654 microversion: 2.20 time: 0.112667 Aug 24 17:53:38.049377 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 357/714] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:37 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1654 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:53:38.093721 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-88effa50-ecfc-40c4-bccc-a5dbca47251a req-396e7b67-861f-4ddc-afdc-c3d592a6c6ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "154f9aac-b081-4041-ba41-dd14fb267e29", "name": "network-vif-deleted", "tag": "12033839-1050-4fb0-90d7-ede010ae619a"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:38.109796 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-88effa50-ecfc-40c4-bccc-a5dbca47251a req-396e7b67-861f-4ddc-afdc-c3d592a6c6ca service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:38.110336 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-88effa50-ecfc-40c4-bccc-a5dbca47251a req-396e7b67-861f-4ddc-afdc-c3d592a6c6ca service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:38.110893 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-88effa50-ecfc-40c4-bccc-a5dbca47251a req-396e7b67-861f-4ddc-afdc-c3d592a6c6ca service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:38.122351 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-88effa50-ecfc-40c4-bccc-a5dbca47251a req-396e7b67-861f-4ddc-afdc-c3d592a6c6ca service nova] Creating event network-vif-deleted:12033839-1050-4fb0-90d7-ede010ae619a for instance 154f9aac-b081-4041-ba41-dd14fb267e29 on hv-cinder-85442 Aug 24 17:53:38.131915 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-88effa50-ecfc-40c4-bccc-a5dbca47251a req-396e7b67-861f-4ddc-afdc-c3d592a6c6ca service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042137 Aug 24 17:53:38.132632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 358/715] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:38.223338 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d282f532-bd9b-439f-a213-3bf7240aa868 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "POST /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.997357 Aug 24 17:53:38.224900 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 358/716] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 17:53:37 2022] POST /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde/os-volume_attachments => generated 194 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:38.391408 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0cf49ef1-4a5c-45b1-95d5-068ba5ab52bb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:38.392252 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0cf49ef1-4a5c-45b1-95d5-068ba5ab52bb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:38.400103 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0cf49ef1-4a5c-45b1-95d5-068ba5ab52bb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:38.401099 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0cf49ef1-4a5c-45b1-95d5-068ba5ab52bb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:38.403698 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0cf49ef1-4a5c-45b1-95d5-068ba5ab52bb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:38.403698 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0cf49ef1-4a5c-45b1-95d5-068ba5ab52bb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:38.403698 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0cf49ef1-4a5c-45b1-95d5-068ba5ab52bb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:38.403698 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0cf49ef1-4a5c-45b1-95d5-068ba5ab52bb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:38.546729 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0cf49ef1-4a5c-45b1-95d5-068ba5ab52bb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:38.554807 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0cf49ef1-4a5c-45b1-95d5-068ba5ab52bb tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1363 microversion: 2.1 time: 0.168235 Aug 24 17:53:38.555512 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 359/717] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:38 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:38.592658 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-78e0cbe8-bd0a-4a3d-bdf4-d3a5afdbc171 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:38.593400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-78e0cbe8-bd0a-4a3d-bdf4-d3a5afdbc171 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:38.599830 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-78e0cbe8-bd0a-4a3d-bdf4-d3a5afdbc171 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:38.600321 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-78e0cbe8-bd0a-4a3d-bdf4-d3a5afdbc171 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:38.600771 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-78e0cbe8-bd0a-4a3d-bdf4-d3a5afdbc171 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:38.601476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-78e0cbe8-bd0a-4a3d-bdf4-d3a5afdbc171 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:38.601973 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-78e0cbe8-bd0a-4a3d-bdf4-d3a5afdbc171 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:38.602409 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-78e0cbe8-bd0a-4a3d-bdf4-d3a5afdbc171 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:38.637081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-78e0cbe8-bd0a-4a3d-bdf4-d3a5afdbc171 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:38.637569 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-78e0cbe8-bd0a-4a3d-bdf4-d3a5afdbc171 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:38.638047 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-78e0cbe8-bd0a-4a3d-bdf4-d3a5afdbc171 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:38.638498 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-78e0cbe8-bd0a-4a3d-bdf4-d3a5afdbc171 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lazy-loading 'fault' on Instance uuid 5a6ce1f4-195d-4f47-aa97-ca63353379cc {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:53:38.685655 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-78e0cbe8-bd0a-4a3d-bdf4-d3a5afdbc171 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:38.693515 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-78e0cbe8-bd0a-4a3d-bdf4-d3a5afdbc171 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1304 microversion: 2.1 time: 0.105234 Aug 24 17:53:38.694309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 359/718] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:38 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:39.076857 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-61b44d23-eeb9-4823-a918-8fe336214b73 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:39.077507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-61b44d23-eeb9-4823-a918-8fe336214b73 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:39.100140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61b44d23-eeb9-4823-a918-8fe336214b73 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:39.100769 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61b44d23-eeb9-4823-a918-8fe336214b73 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:39.101331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61b44d23-eeb9-4823-a918-8fe336214b73 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:39.102283 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61b44d23-eeb9-4823-a918-8fe336214b73 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:39.102899 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61b44d23-eeb9-4823-a918-8fe336214b73 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:39.103484 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61b44d23-eeb9-4823-a918-8fe336214b73 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:39.140422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61b44d23-eeb9-4823-a918-8fe336214b73 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:39.140993 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61b44d23-eeb9-4823-a918-8fe336214b73 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:39.141763 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61b44d23-eeb9-4823-a918-8fe336214b73 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:39.142361 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-61b44d23-eeb9-4823-a918-8fe336214b73 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lazy-loading 'fault' on Instance uuid 154f9aac-b081-4041-ba41-dd14fb267e29 {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:53:39.205539 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-61b44d23-eeb9-4823-a918-8fe336214b73 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:39.214683 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-61b44d23-eeb9-4823-a918-8fe336214b73 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:39.216202 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-61b44d23-eeb9-4823-a918-8fe336214b73 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:39.217372 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-61b44d23-eeb9-4823-a918-8fe336214b73 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 200 len: 1370 microversion: 2.20 time: 0.145630 Aug 24 17:53:39.217969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 360/719] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:39 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:39.578632 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0612278d-1ad1-4101-a0b9-caab03cd32ec tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:39.579529 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0612278d-1ad1-4101-a0b9-caab03cd32ec tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:39.585671 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0612278d-1ad1-4101-a0b9-caab03cd32ec tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:39.586122 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0612278d-1ad1-4101-a0b9-caab03cd32ec tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:39.586567 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0612278d-1ad1-4101-a0b9-caab03cd32ec tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:39.587276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0612278d-1ad1-4101-a0b9-caab03cd32ec tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:39.587736 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0612278d-1ad1-4101-a0b9-caab03cd32ec tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:39.588165 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0612278d-1ad1-4101-a0b9-caab03cd32ec tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:39.716908 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3220133d-1c7e-47c1-a9d6-5d8645d6b9cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:39.717526 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3220133d-1c7e-47c1-a9d6-5d8645d6b9cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:39.724458 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3220133d-1c7e-47c1-a9d6-5d8645d6b9cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:39.725472 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3220133d-1c7e-47c1-a9d6-5d8645d6b9cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:39.725472 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3220133d-1c7e-47c1-a9d6-5d8645d6b9cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:39.726088 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3220133d-1c7e-47c1-a9d6-5d8645d6b9cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:39.726602 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3220133d-1c7e-47c1-a9d6-5d8645d6b9cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:39.727029 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3220133d-1c7e-47c1-a9d6-5d8645d6b9cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:39.736397 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0612278d-1ad1-4101-a0b9-caab03cd32ec tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:39.746012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0612278d-1ad1-4101-a0b9-caab03cd32ec tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1554 microversion: 2.1 time: 0.170891 Aug 24 17:53:39.746712 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 360/720] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:39 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:39.760337 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3220133d-1c7e-47c1-a9d6-5d8645d6b9cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:39.761166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3220133d-1c7e-47c1-a9d6-5d8645d6b9cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:39.761612 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3220133d-1c7e-47c1-a9d6-5d8645d6b9cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:39.762088 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-3220133d-1c7e-47c1-a9d6-5d8645d6b9cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lazy-loading 'fault' on Instance uuid 5a6ce1f4-195d-4f47-aa97-ca63353379cc {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:53:39.771027 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-73e2b6f7-4402-4dac-b502-c51bee87fcbd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:39.771556 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-73e2b6f7-4402-4dac-b502-c51bee87fcbd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:39.781959 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-73e2b6f7-4402-4dac-b502-c51bee87fcbd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:39.786708 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-73e2b6f7-4402-4dac-b502-c51bee87fcbd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:39.786708 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-73e2b6f7-4402-4dac-b502-c51bee87fcbd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:39.786708 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-73e2b6f7-4402-4dac-b502-c51bee87fcbd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:39.786708 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-73e2b6f7-4402-4dac-b502-c51bee87fcbd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:39.787069 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-73e2b6f7-4402-4dac-b502-c51bee87fcbd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:39.807707 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3220133d-1c7e-47c1-a9d6-5d8645d6b9cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08b2eba50904dda89fb743c9cf28958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e895dd83dbf4458b7d6efaace0d209a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:39.815844 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3220133d-1c7e-47c1-a9d6-5d8645d6b9cb tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 200 len: 1304 microversion: 2.1 time: 0.103290 Aug 24 17:53:39.816484 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 361/721] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:39 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:39.876592 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-73e2b6f7-4402-4dac-b502-c51bee87fcbd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109797 Aug 24 17:53:39.878688 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 361/722] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 24 17:53:39 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:40.240779 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a89c375f-a066-4bad-81b6-6aeacdaf9dd8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:40.241362 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a89c375f-a066-4bad-81b6-6aeacdaf9dd8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:40.247973 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a89c375f-a066-4bad-81b6-6aeacdaf9dd8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:40.248461 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a89c375f-a066-4bad-81b6-6aeacdaf9dd8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:40.248902 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a89c375f-a066-4bad-81b6-6aeacdaf9dd8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:40.249597 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a89c375f-a066-4bad-81b6-6aeacdaf9dd8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:40.250097 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a89c375f-a066-4bad-81b6-6aeacdaf9dd8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:40.250578 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a89c375f-a066-4bad-81b6-6aeacdaf9dd8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:40.266267 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-a89c375f-a066-4bad-81b6-6aeacdaf9dd8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] HTTP exception thrown: Instance 154f9aac-b081-4041-ba41-dd14fb267e29 could not be found. Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a89c375f-a066-4bad-81b6-6aeacdaf9dd8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Request method failure captured: Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 HTTP/1.1 Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmSk5iMtuYydttn7hEIrtz40Lsk0SWcumQLhHV0Yf30yrwyN8KK5JOdD-oy4auRdOq0TwWoA5gJHttiNDyWAwrcNJGQDmZ3pNLkPDxiEbhtzondqzIfOPRkl8aqIzKHq5CGvo6SYHEIXirvNyjvzyVL-UOLYPSZ6sEDfBGGpRkM3PP8 Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 9398272c7a3f4a50a38df4b5dec9ac90 Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1996245533 Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:53:40.267964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:53:40.269589 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9398272c7a3f4a50a38df4b5dec9ac90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9398272c7a3f4a50a38df4b5dec9ac90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9398272c7a3f4a50a38df4b5dec9ac90", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9398272c7a3f4a50a38df4b5dec9ac90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:53:40.269589 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1996245533 Aug 24 17:53:40.269589 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 9398272c7a3f4a50a38df4b5dec9ac90 Aug 24 17:53:40.269589 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1996245533 Aug 24 17:53:40.269589 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-AttachVolumeShelveTestJSON-1996245533-project Aug 24 17:53:40.269589 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:53:40.269589 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:53:40.269589 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: 612dfebb8ebc401bb81d3d3333577566 Aug 24 17:53:40.269589 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1996245533-project Aug 24 17:53:40.269589 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:53:40.269589 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance 154f9aac-b081-4041-ba41-dd14fb267e29 could not be found. Aug 24 17:53:40.269589 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': '154f9aac-b081-4041-ba41-dd14fb267e29'} Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 154f9aac-b081-4041-ba41-dd14fb267e29 could not be found. Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:53:40.270425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:53:40.271672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:53:40.271672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:53:40.271672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:53:40.271672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:53:40.271672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:53:40.271672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:53:40.271672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:53:40.271672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 154f9aac-b081-4041-ba41-dd14fb267e29 could not be found. Aug 24 17:53:40.271672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:53:40.271672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:53:40.271672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:53:40.271672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:40.271672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:53:40.271672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:53:40.271672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:53:40.271672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:53:40.271672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 154f9aac-b081-4041-ba41-dd14fb267e29 could not be found. Aug 24 17:53:40.271672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:53:40.273041 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a89c375f-a066-4bad-81b6-6aeacdaf9dd8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Returning 404 to user: Instance 154f9aac-b081-4041-ba41-dd14fb267e29 could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:53:40.273041 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a89c375f-a066-4bad-81b6-6aeacdaf9dd8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 404 len: 111 microversion: 2.20 time: 0.032711 Aug 24 17:53:40.273041 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 362/723] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:40 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:53:40.279704 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-20d96b63-cff5-4c51-9406-a64fc6393b51 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '.version_select at 0x7fce7754dee0>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:40.359334 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-20d96b63-cff5-4c51-9406-a64fc6393b51 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-197525532" status: 204 len: 0 microversion: 2.20 time: 0.084375 Aug 24 17:53:40.359924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 362/724] 10.222.0.76 () {60 vars in 1259 bytes} [Wed Aug 24 17:53:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-197525532 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 17:53:40.837373 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-614e7a45-724b-4a50-88f8-30aec9dd5247 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:40.839910 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-614e7a45-724b-4a50-88f8-30aec9dd5247 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] [instance: 5a6ce1f4-195d-4f47-aa97-ca63353379cc] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:40.849499 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-614e7a45-724b-4a50-88f8-30aec9dd5247 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:40.850211 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-614e7a45-724b-4a50-88f8-30aec9dd5247 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:40.850751 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-614e7a45-724b-4a50-88f8-30aec9dd5247 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:40.851917 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-614e7a45-724b-4a50-88f8-30aec9dd5247 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:40.852952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-614e7a45-724b-4a50-88f8-30aec9dd5247 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:40.852952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-614e7a45-724b-4a50-88f8-30aec9dd5247 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:40.870335 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-614e7a45-724b-4a50-88f8-30aec9dd5247 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] HTTP exception thrown: Instance 5a6ce1f4-195d-4f47-aa97-ca63353379cc could not be found. Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-614e7a45-724b-4a50-88f8-30aec9dd5247 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Request method failure captured: Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc HTTP/1.1 Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmVSfOJAxbbqGbJVkFRssVjdZz6GWKRJQwRBIMFOLp8V2ZUOdniItDKslKkzLh7B_jn5veiF-jrFsm5hjvCUekpqSYO_6-keYvXUsIgsuYKaVjtAtt5CGzKjffGl-IMmQxV6_YDUGkxEKOcam84p7u1mutffiXro1SR8mm-U3WWpJpI Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 6e895dd83dbf4458b7d6efaace0d209a Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-VolumesActionsTest-871884221 Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:53:40.872493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:53:40.873770 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/6e895dd83dbf4458b7d6efaace0d209a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6e895dd83dbf4458b7d6efaace0d209a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_6e895dd83dbf4458b7d6efaace0d209a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/6e895dd83dbf4458b7d6efaace0d209a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:53:40.873770 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-VolumesActionsTest-871884221 Aug 24 17:53:40.873770 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 6e895dd83dbf4458b7d6efaace0d209a Aug 24 17:53:40.873770 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-VolumesActionsTest-871884221 Aug 24 17:53:40.873770 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-VolumesActionsTest-871884221-project Aug 24 17:53:40.873770 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:53:40.873770 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:53:40.873770 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: f08b2eba50904dda89fb743c9cf28958 Aug 24 17:53:40.873770 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-VolumesActionsTest-871884221-project Aug 24 17:53:40.873770 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:53:40.873770 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance 5a6ce1f4-195d-4f47-aa97-ca63353379cc could not be found. Aug 24 17:53:40.873770 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': '5a6ce1f4-195d-4f47-aa97-ca63353379cc'} Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a6ce1f4-195d-4f47-aa97-ca63353379cc could not be found. Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:53:40.874519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:53:40.875659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:53:40.875659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:53:40.875659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:53:40.875659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:53:40.875659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:53:40.875659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:53:40.875659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:53:40.875659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a6ce1f4-195d-4f47-aa97-ca63353379cc could not be found. Aug 24 17:53:40.875659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:53:40.875659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:53:40.875659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:53:40.875659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:40.875659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:53:40.875659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:53:40.875659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:53:40.875659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:53:40.875659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a6ce1f4-195d-4f47-aa97-ca63353379cc could not be found. Aug 24 17:53:40.875659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:53:40.878569 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-614e7a45-724b-4a50-88f8-30aec9dd5247 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] Returning 404 to user: Instance 5a6ce1f4-195d-4f47-aa97-ca63353379cc could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:53:40.879810 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-614e7a45-724b-4a50-88f8-30aec9dd5247 tempest-VolumesActionsTest-871884221 tempest-VolumesActionsTest-871884221-project] 10.222.0.76 "GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc" status: 404 len: 111 microversion: 2.1 time: 0.046886 Aug 24 17:53:40.882217 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 363/725] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:40 2022] GET /compute/v2.1/servers/5a6ce1f4-195d-4f47-aa97-ca63353379cc => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:53:40.997632 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-4e5d1e81-01bf-459f-9dd2-2c452e60e539 req-85f9fe46-9c83-4e60-8ee2-47bbc03b2cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4c5b83-10ba-4343-a209-f00a509aa20f", "tag": "df84b545-e21e-40dc-a01c-73704d9d9f09"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:41.009642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-4e5d1e81-01bf-459f-9dd2-2c452e60e539 req-85f9fe46-9c83-4e60-8ee2-47bbc03b2cd9 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:41.010766 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-4e5d1e81-01bf-459f-9dd2-2c452e60e539 req-85f9fe46-9c83-4e60-8ee2-47bbc03b2cd9 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:41.011294 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-4e5d1e81-01bf-459f-9dd2-2c452e60e539 req-85f9fe46-9c83-4e60-8ee2-47bbc03b2cd9 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:41.028433 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-4e5d1e81-01bf-459f-9dd2-2c452e60e539 req-85f9fe46-9c83-4e60-8ee2-47bbc03b2cd9 service nova] Creating event network-changed:df84b545-e21e-40dc-a01c-73704d9d9f09 for instance ea4c5b83-10ba-4343-a209-f00a509aa20f on hv-cinder-85442 Aug 24 17:53:41.033616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-4e5d1e81-01bf-459f-9dd2-2c452e60e539 req-85f9fe46-9c83-4e60-8ee2-47bbc03b2cd9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040984 Aug 24 17:53:41.034520 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 363/726] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:41.382149 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-2f42b5a1-b836-4350-9f10-620988b038a1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Action: 'create', calling method: .version_select at 0x7fce774d7280>, body: {"keypair": {"name": "tempest-keypair-488806812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjXx9ouNvrc4FOQZP46yqH3hqGwBCQ6EcPHGBfcot1ChxSfsLSTLfo+1Wk70vbEbnnJE8rsugUfNjsZW49OJWVxZo80XdHcWvL9tXdTNgVFdBzlIUP6fMm6+pBTjFddnQ=="}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:41.401060 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-2f42b5a1-b836-4350-9f10-620988b038a1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Getting quotas for project 9398272c7a3f4a50a38df4b5dec9ac90. Resources: {'key_pairs'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:53:41.406045 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-2f42b5a1-b836-4350-9f10-620988b038a1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Getting quotas for user 612dfebb8ebc401bb81d3d3333577566 and project 9398272c7a3f4a50a38df4b5dec9ac90. Resources: {'key_pairs'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:53:41.415583 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:41.508457 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-2f42b5a1-b836-4350-9f10-620988b038a1 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.130390 Aug 24 17:53:41.509216 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 364/727] 10.222.0.76 () {62 vars in 1200 bytes} [Wed Aug 24 17:53:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 24 17:53:44.423424 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-555f9d55-cb04-42cc-87ec-5e06d523208d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1914560226", "imageRef": "2d76d745-abc6-4a7b-b8d7-46566b66934b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "010bcf84-2f06-4274-8553-0a7884f5d83e"}], "security_groups": [{"name": "tempest-securitygroup--1344131153"}], "key_name": "tempest-keypair-488806812", "user_data": "}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:44.538261 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.network.neutron [None req-555f9d55-cb04-42cc-87ec-5e06d523208d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] validate_networks() for [('010bcf84-2f06-4274-8553-0a7884f5d83e', None, None, None, None, None)] {{(pid=127676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:53:45.265394 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-555f9d55-cb04-42cc-87ec-5e06d523208d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Flavor limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:53:45.265820 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-555f9d55-cb04-42cc-87ec-5e06d523208d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Image limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:53:45.266332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-555f9d55-cb04-42cc-87ec-5e06d523208d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Flavor pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:53:45.266776 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-555f9d55-cb04-42cc-87ec-5e06d523208d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Image pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:53:45.267190 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-555f9d55-cb04-42cc-87ec-5e06d523208d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:53:45.276339 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-555f9d55-cb04-42cc-87ec-5e06d523208d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:45.276821 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-555f9d55-cb04-42cc-87ec-5e06d523208d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:45.277356 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-555f9d55-cb04-42cc-87ec-5e06d523208d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:45.278187 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-555f9d55-cb04-42cc-87ec-5e06d523208d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:45.278666 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-555f9d55-cb04-42cc-87ec-5e06d523208d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:45.279106 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-555f9d55-cb04-42cc-87ec-5e06d523208d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:45.298453 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-555f9d55-cb04-42cc-87ec-5e06d523208d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Getting quotas for project 9398272c7a3f4a50a38df4b5dec9ac90. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:53:45.302786 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-555f9d55-cb04-42cc-87ec-5e06d523208d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Getting quotas for user 612dfebb8ebc401bb81d3d3333577566 and project 9398272c7a3f4a50a38df4b5dec9ac90. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:53:45.318588 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-555f9d55-cb04-42cc-87ec-5e06d523208d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Going to run 1 instances... {{(pid=127676) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:53:45.321142 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-555f9d55-cb04-42cc-87ec-5e06d523208d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d76d745-abc6-4a7b-b8d7-46566b66934b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:53:45.462331 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-555f9d55-cb04-42cc-87ec-5e06d523208d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.046121 Aug 24 17:53:45.463021 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 364/728] 10.222.0.76 () {62 vars in 1188 bytes} [Wed Aug 24 17:53:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 17:53:45.475973 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-6f2d27e0-571a-4ac1-bb38-5391f884e216 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:45.476734 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-6f2d27e0-571a-4ac1-bb38-5391f884e216 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:45.536565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-6f2d27e0-571a-4ac1-bb38-5391f884e216 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:45.545799 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-6f2d27e0-571a-4ac1-bb38-5391f884e216 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:45.547476 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-6f2d27e0-571a-4ac1-bb38-5391f884e216 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:45.548722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-6f2d27e0-571a-4ac1-bb38-5391f884e216 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1281 microversion: 2.20 time: 0.077489 Aug 24 17:53:45.549284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 365/729] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:45 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1281 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:53:46.574712 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-9de5f4df-6b6a-4182-8ee9-b8d5d8e956c7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:46.575747 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-9de5f4df-6b6a-4182-8ee9-b8d5d8e956c7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:46.584301 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9de5f4df-6b6a-4182-8ee9-b8d5d8e956c7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:46.584885 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9de5f4df-6b6a-4182-8ee9-b8d5d8e956c7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:46.585309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9de5f4df-6b6a-4182-8ee9-b8d5d8e956c7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:46.586097 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9de5f4df-6b6a-4182-8ee9-b8d5d8e956c7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:46.586567 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9de5f4df-6b6a-4182-8ee9-b8d5d8e956c7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:46.586995 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9de5f4df-6b6a-4182-8ee9-b8d5d8e956c7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:46.653498 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-9de5f4df-6b6a-4182-8ee9-b8d5d8e956c7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:46.662845 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-9de5f4df-6b6a-4182-8ee9-b8d5d8e956c7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:46.664443 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-9de5f4df-6b6a-4182-8ee9-b8d5d8e956c7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:46.665688 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-9de5f4df-6b6a-4182-8ee9-b8d5d8e956c7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1285 microversion: 2.20 time: 0.097315 Aug 24 17:53:46.666314 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 365/730] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:46 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:47.689703 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-581e735e-5b3e-415c-a2f4-85bfe61c80ce tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:47.691197 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-581e735e-5b3e-415c-a2f4-85bfe61c80ce tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:47.700041 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-581e735e-5b3e-415c-a2f4-85bfe61c80ce tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:47.700875 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-581e735e-5b3e-415c-a2f4-85bfe61c80ce tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:47.701506 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-581e735e-5b3e-415c-a2f4-85bfe61c80ce tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:47.703104 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-581e735e-5b3e-415c-a2f4-85bfe61c80ce tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:47.706810 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-581e735e-5b3e-415c-a2f4-85bfe61c80ce tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:47.707944 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-581e735e-5b3e-415c-a2f4-85bfe61c80ce tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:47.795856 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-581e735e-5b3e-415c-a2f4-85bfe61c80ce tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:47.815854 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-581e735e-5b3e-415c-a2f4-85bfe61c80ce tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:47.817964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-581e735e-5b3e-415c-a2f4-85bfe61c80ce tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:47.819106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-581e735e-5b3e-415c-a2f4-85bfe61c80ce tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1333 microversion: 2.20 time: 0.133533 Aug 24 17:53:47.819844 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 366/731] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:47 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1333 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:48.854245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-bd42f34f-3c6a-4f09-9a50-8e32b89b79d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:48.855737 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-bd42f34f-3c6a-4f09-9a50-8e32b89b79d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:48.873834 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bd42f34f-3c6a-4f09-9a50-8e32b89b79d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:48.874630 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bd42f34f-3c6a-4f09-9a50-8e32b89b79d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:48.875276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bd42f34f-3c6a-4f09-9a50-8e32b89b79d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:48.876451 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bd42f34f-3c6a-4f09-9a50-8e32b89b79d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:48.877084 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bd42f34f-3c6a-4f09-9a50-8e32b89b79d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:48.877667 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-bd42f34f-3c6a-4f09-9a50-8e32b89b79d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:49.009660 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-bd42f34f-3c6a-4f09-9a50-8e32b89b79d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:49.024344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-bd42f34f-3c6a-4f09-9a50-8e32b89b79d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:49.027096 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-bd42f34f-3c6a-4f09-9a50-8e32b89b79d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:49.028677 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-bd42f34f-3c6a-4f09-9a50-8e32b89b79d8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1339 microversion: 2.20 time: 0.184761 Aug 24 17:53:49.030062 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 366/732] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:48 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1339 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:53:50.053565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-5acc6ff8-b2c6-4fac-8b47-e9e75485fe03 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:50.054184 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-5acc6ff8-b2c6-4fac-8b47-e9e75485fe03 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:50.062371 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5acc6ff8-b2c6-4fac-8b47-e9e75485fe03 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:50.063573 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5acc6ff8-b2c6-4fac-8b47-e9e75485fe03 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:50.064023 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5acc6ff8-b2c6-4fac-8b47-e9e75485fe03 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:50.064760 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5acc6ff8-b2c6-4fac-8b47-e9e75485fe03 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:50.065221 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5acc6ff8-b2c6-4fac-8b47-e9e75485fe03 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:50.065652 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5acc6ff8-b2c6-4fac-8b47-e9e75485fe03 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:50.351480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5acc6ff8-b2c6-4fac-8b47-e9e75485fe03 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:50.351480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5acc6ff8-b2c6-4fac-8b47-e9e75485fe03 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:50.351921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5acc6ff8-b2c6-4fac-8b47-e9e75485fe03 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:50.351921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-5acc6ff8-b2c6-4fac-8b47-e9e75485fe03 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1407 microversion: 2.20 time: 0.187121 Aug 24 17:53:50.351921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 367/733] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:50 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:53:51.376849 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-98d0c882-31f1-4095-9495-d0bec307ec7b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:51.378574 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-98d0c882-31f1-4095-9495-d0bec307ec7b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:51.388436 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98d0c882-31f1-4095-9495-d0bec307ec7b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:51.389305 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98d0c882-31f1-4095-9495-d0bec307ec7b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:51.390019 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98d0c882-31f1-4095-9495-d0bec307ec7b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:51.390959 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98d0c882-31f1-4095-9495-d0bec307ec7b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:51.391819 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98d0c882-31f1-4095-9495-d0bec307ec7b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:51.392485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98d0c882-31f1-4095-9495-d0bec307ec7b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:51.595500 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-98d0c882-31f1-4095-9495-d0bec307ec7b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:51.606963 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-98d0c882-31f1-4095-9495-d0bec307ec7b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:51.608794 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-98d0c882-31f1-4095-9495-d0bec307ec7b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:51.610127 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-98d0c882-31f1-4095-9495-d0bec307ec7b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1407 microversion: 2.20 time: 0.238293 Aug 24 17:53:51.611001 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 367/734] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:51 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:51.930159 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-50ea29b5-88a8-43c0-aa39-9995cd5a4758 req-b0cb8c9c-c8b1-4cbf-9187-4ed0707a240d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "861f638b-1bdf-459e-bf10-2846d8994ac4", "tag": "83c659e2-8827-4402-9131-6edb2b9b0a44"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:51.951149 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-50ea29b5-88a8-43c0-aa39-9995cd5a4758 req-b0cb8c9c-c8b1-4cbf-9187-4ed0707a240d service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:51.951922 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-50ea29b5-88a8-43c0-aa39-9995cd5a4758 req-b0cb8c9c-c8b1-4cbf-9187-4ed0707a240d service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:51.953203 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-50ea29b5-88a8-43c0-aa39-9995cd5a4758 req-b0cb8c9c-c8b1-4cbf-9187-4ed0707a240d service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:51.971549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-50ea29b5-88a8-43c0-aa39-9995cd5a4758 req-b0cb8c9c-c8b1-4cbf-9187-4ed0707a240d service nova] Creating event network-changed:83c659e2-8827-4402-9131-6edb2b9b0a44 for instance 861f638b-1bdf-459e-bf10-2846d8994ac4 on hv-cinder-85442 Aug 24 17:53:51.977584 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-50ea29b5-88a8-43c0-aa39-9995cd5a4758 req-b0cb8c9c-c8b1-4cbf-9187-4ed0707a240d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064497 Aug 24 17:53:51.978231 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 368/735] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:52.634610 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-01e79fd3-acd5-43ce-b55b-1a306174a9f6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:52.635418 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-01e79fd3-acd5-43ce-b55b-1a306174a9f6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:52.642690 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-01e79fd3-acd5-43ce-b55b-1a306174a9f6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:52.643503 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-01e79fd3-acd5-43ce-b55b-1a306174a9f6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:52.644160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-01e79fd3-acd5-43ce-b55b-1a306174a9f6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:52.644872 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-01e79fd3-acd5-43ce-b55b-1a306174a9f6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:52.645626 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-01e79fd3-acd5-43ce-b55b-1a306174a9f6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:52.646094 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-01e79fd3-acd5-43ce-b55b-1a306174a9f6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:52.821081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-01e79fd3-acd5-43ce-b55b-1a306174a9f6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:52.831784 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-01e79fd3-acd5-43ce-b55b-1a306174a9f6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:52.834224 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-01e79fd3-acd5-43ce-b55b-1a306174a9f6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:52.835842 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-01e79fd3-acd5-43ce-b55b-1a306174a9f6 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1407 microversion: 2.20 time: 0.205654 Aug 24 17:53:52.836672 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 368/736] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:52 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:53.860156 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d2fbe04f-2352-4921-89a5-5834331cb7c5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:53.861064 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d2fbe04f-2352-4921-89a5-5834331cb7c5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:53.870150 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d2fbe04f-2352-4921-89a5-5834331cb7c5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:53.870791 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d2fbe04f-2352-4921-89a5-5834331cb7c5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:53.871475 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d2fbe04f-2352-4921-89a5-5834331cb7c5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:53.872378 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d2fbe04f-2352-4921-89a5-5834331cb7c5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:53.872985 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d2fbe04f-2352-4921-89a5-5834331cb7c5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:53.873561 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d2fbe04f-2352-4921-89a5-5834331cb7c5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:54.052340 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d2fbe04f-2352-4921-89a5-5834331cb7c5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:54.064638 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d2fbe04f-2352-4921-89a5-5834331cb7c5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:54.066471 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d2fbe04f-2352-4921-89a5-5834331cb7c5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:54.068214 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d2fbe04f-2352-4921-89a5-5834331cb7c5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1407 microversion: 2.20 time: 0.212511 Aug 24 17:53:54.069665 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 369/737] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:53 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:55.092246 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-76a5fa20-e18d-4f31-8c3c-bd72a7ada14c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:55.093532 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-76a5fa20-e18d-4f31-8c3c-bd72a7ada14c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:55.100376 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-76a5fa20-e18d-4f31-8c3c-bd72a7ada14c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:55.100943 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-76a5fa20-e18d-4f31-8c3c-bd72a7ada14c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:55.101531 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-76a5fa20-e18d-4f31-8c3c-bd72a7ada14c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:55.102396 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-76a5fa20-e18d-4f31-8c3c-bd72a7ada14c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:55.103070 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-76a5fa20-e18d-4f31-8c3c-bd72a7ada14c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:55.103712 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-76a5fa20-e18d-4f31-8c3c-bd72a7ada14c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:55.255479 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-76a5fa20-e18d-4f31-8c3c-bd72a7ada14c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:55.265000 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-76a5fa20-e18d-4f31-8c3c-bd72a7ada14c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:55.266592 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-76a5fa20-e18d-4f31-8c3c-bd72a7ada14c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:55.267799 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-76a5fa20-e18d-4f31-8c3c-bd72a7ada14c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1407 microversion: 2.20 time: 0.180154 Aug 24 17:53:55.268617 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 369/738] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:55 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:56.291578 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3796931f-c2a6-4d42-a618-557a6268b730 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:56.293976 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3796931f-c2a6-4d42-a618-557a6268b730 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:56.297684 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=6 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:56.302937 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3796931f-c2a6-4d42-a618-557a6268b730 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:56.303632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3796931f-c2a6-4d42-a618-557a6268b730 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:56.304038 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3796931f-c2a6-4d42-a618-557a6268b730 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:56.304734 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3796931f-c2a6-4d42-a618-557a6268b730 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:56.305180 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3796931f-c2a6-4d42-a618-557a6268b730 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:56.305730 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3796931f-c2a6-4d42-a618-557a6268b730 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:56.463558 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3796931f-c2a6-4d42-a618-557a6268b730 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:56.473682 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3796931f-c2a6-4d42-a618-557a6268b730 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:56.475612 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3796931f-c2a6-4d42-a618-557a6268b730 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:56.476932 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3796931f-c2a6-4d42-a618-557a6268b730 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1407 microversion: 2.20 time: 0.189468 Aug 24 17:53:56.477495 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 370/739] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:56 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:57.502904 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-fa3ee3ee-9f7b-4d76-a7f2-51445563c32a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:57.504154 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-fa3ee3ee-9f7b-4d76-a7f2-51445563c32a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:57.506430 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=2 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:57.507424 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=6 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:57.514190 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fa3ee3ee-9f7b-4d76-a7f2-51445563c32a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:57.514964 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fa3ee3ee-9f7b-4d76-a7f2-51445563c32a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:57.515566 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fa3ee3ee-9f7b-4d76-a7f2-51445563c32a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:57.516454 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fa3ee3ee-9f7b-4d76-a7f2-51445563c32a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:57.517092 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fa3ee3ee-9f7b-4d76-a7f2-51445563c32a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:57.517533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fa3ee3ee-9f7b-4d76-a7f2-51445563c32a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:57.739989 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-fa3ee3ee-9f7b-4d76-a7f2-51445563c32a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:57.750775 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-fa3ee3ee-9f7b-4d76-a7f2-51445563c32a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:57.752336 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-fa3ee3ee-9f7b-4d76-a7f2-51445563c32a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:57.753526 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-fa3ee3ee-9f7b-4d76-a7f2-51445563c32a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1407 microversion: 2.20 time: 0.254903 Aug 24 17:53:57.754526 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 370/740] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:57 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:58.797976 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-de61b269-d3c8-44a8-b11f-51816242095b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:58.799153 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-de61b269-d3c8-44a8-b11f-51816242095b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:58.812351 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-de61b269-d3c8-44a8-b11f-51816242095b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:58.813500 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-de61b269-d3c8-44a8-b11f-51816242095b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:58.814311 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-de61b269-d3c8-44a8-b11f-51816242095b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:58.815878 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-de61b269-d3c8-44a8-b11f-51816242095b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:58.816614 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-de61b269-d3c8-44a8-b11f-51816242095b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:58.817399 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-de61b269-d3c8-44a8-b11f-51816242095b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:59.071205 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-de61b269-d3c8-44a8-b11f-51816242095b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:59.082892 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-de61b269-d3c8-44a8-b11f-51816242095b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:59.084861 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-de61b269-d3c8-44a8-b11f-51816242095b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:59.086033 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-de61b269-d3c8-44a8-b11f-51816242095b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1407 microversion: 2.20 time: 0.294434 Aug 24 17:53:59.102364 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 371/741] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:58 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:00.014217 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-42f99b2c-db60-4cf0-8c6a-cc73fadd5c26 req-33f02d57-de4e-402b-a9ec-63b70d961c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861f638b-1bdf-459e-bf10-2846d8994ac4", "name": "network-vif-plugged", "status": "completed", "tag": "83c659e2-8827-4402-9131-6edb2b9b0a44"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:00.028102 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-42f99b2c-db60-4cf0-8c6a-cc73fadd5c26 req-33f02d57-de4e-402b-a9ec-63b70d961c89 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:00.028610 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-42f99b2c-db60-4cf0-8c6a-cc73fadd5c26 req-33f02d57-de4e-402b-a9ec-63b70d961c89 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:00.029028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-42f99b2c-db60-4cf0-8c6a-cc73fadd5c26 req-33f02d57-de4e-402b-a9ec-63b70d961c89 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:00.044277 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-42f99b2c-db60-4cf0-8c6a-cc73fadd5c26 req-33f02d57-de4e-402b-a9ec-63b70d961c89 service nova] Creating event network-vif-plugged:83c659e2-8827-4402-9131-6edb2b9b0a44 for instance 861f638b-1bdf-459e-bf10-2846d8994ac4 on hv-cinder-85442 Aug 24 17:54:00.050314 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-42f99b2c-db60-4cf0-8c6a-cc73fadd5c26 req-33f02d57-de4e-402b-a9ec-63b70d961c89 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041806 Aug 24 17:54:00.051009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 371/742] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:00.109747 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f643b801-b1dc-4824-b55c-8bada46cea6d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:00.111915 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-f643b801-b1dc-4824-b55c-8bada46cea6d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:00.120588 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f643b801-b1dc-4824-b55c-8bada46cea6d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:00.121791 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f643b801-b1dc-4824-b55c-8bada46cea6d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:00.122623 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f643b801-b1dc-4824-b55c-8bada46cea6d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:00.123960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f643b801-b1dc-4824-b55c-8bada46cea6d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:00.124694 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f643b801-b1dc-4824-b55c-8bada46cea6d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:00.125240 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f643b801-b1dc-4824-b55c-8bada46cea6d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:00.288837 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f643b801-b1dc-4824-b55c-8bada46cea6d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:00.298313 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f643b801-b1dc-4824-b55c-8bada46cea6d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:00.299828 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f643b801-b1dc-4824-b55c-8bada46cea6d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:00.300983 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-f643b801-b1dc-4824-b55c-8bada46cea6d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1407 microversion: 2.20 time: 0.195380 Aug 24 17:54:00.305037 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 372/743] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:00 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:01.326179 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-3d648229-c014-4a7a-8875-530046524904 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:01.326886 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-3d648229-c014-4a7a-8875-530046524904 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:01.333884 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3d648229-c014-4a7a-8875-530046524904 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:01.334478 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3d648229-c014-4a7a-8875-530046524904 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:01.334992 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3d648229-c014-4a7a-8875-530046524904 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:01.336004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3d648229-c014-4a7a-8875-530046524904 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:01.336378 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3d648229-c014-4a7a-8875-530046524904 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:01.336809 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3d648229-c014-4a7a-8875-530046524904 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:01.411306 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-81f88933-291f-4fa8-b78c-f5cc3b83d9e7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:01.412465 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-81f88933-291f-4fa8-b78c-f5cc3b83d9e7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:01.420224 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-81f88933-291f-4fa8-b78c-f5cc3b83d9e7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:01.420956 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-81f88933-291f-4fa8-b78c-f5cc3b83d9e7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:01.421578 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-81f88933-291f-4fa8-b78c-f5cc3b83d9e7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:01.422488 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-81f88933-291f-4fa8-b78c-f5cc3b83d9e7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:01.423129 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-81f88933-291f-4fa8-b78c-f5cc3b83d9e7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:01.423882 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-81f88933-291f-4fa8-b78c-f5cc3b83d9e7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:01.512664 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-3d648229-c014-4a7a-8875-530046524904 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:01.522089 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-3d648229-c014-4a7a-8875-530046524904 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:01.527758 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-3d648229-c014-4a7a-8875-530046524904 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:01.530716 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-3d648229-c014-4a7a-8875-530046524904 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1407 microversion: 2.20 time: 0.210055 Aug 24 17:54:01.531283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 372/744] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:01 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:01.547885 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-81f88933-291f-4fa8-b78c-f5cc3b83d9e7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lazy-loading 'services' on Instance uuid 04727389-f440-431a-83b1-12243a4dcfde {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:54:01.791639 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-81f88933-291f-4fa8-b78c-f5cc3b83d9e7 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "DELETE /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde/os-volume_attachments/de120c82-3e33-4691-b612-ba13c8dab3a3" status: 202 len: 0 microversion: 2.1 time: 0.384387 Aug 24 17:54:01.796316 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 373/745] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 17:54:01 2022] DELETE /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde/os-volume_attachments/de120c82-3e33-4691-b612-ba13c8dab3a3 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:54:02.449029 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-332718df-5eae-4f1b-acf8-2f0443977f6c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee355dd0-4818-44f6-a8a2-c31f104d6bf0"}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:02.453741 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-332718df-5eae-4f1b-acf8-2f0443977f6c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:02.463304 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-332718df-5eae-4f1b-acf8-2f0443977f6c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:02.464663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-332718df-5eae-4f1b-acf8-2f0443977f6c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:02.465371 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-332718df-5eae-4f1b-acf8-2f0443977f6c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:02.466549 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-332718df-5eae-4f1b-acf8-2f0443977f6c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:02.467549 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-332718df-5eae-4f1b-acf8-2f0443977f6c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:02.468459 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-332718df-5eae-4f1b-acf8-2f0443977f6c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:02.556943 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e491103d-297c-42d6-8135-c192e7016967 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:02.557668 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-e491103d-297c-42d6-8135-c192e7016967 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:02.564420 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e491103d-297c-42d6-8135-c192e7016967 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:02.565266 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e491103d-297c-42d6-8135-c192e7016967 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:02.565915 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e491103d-297c-42d6-8135-c192e7016967 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:02.566888 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e491103d-297c-42d6-8135-c192e7016967 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:02.567359 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e491103d-297c-42d6-8135-c192e7016967 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:02.567976 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e491103d-297c-42d6-8135-c192e7016967 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:02.753734 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e491103d-297c-42d6-8135-c192e7016967 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:02.765751 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e491103d-297c-42d6-8135-c192e7016967 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:02.767756 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e491103d-297c-42d6-8135-c192e7016967 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:02.769385 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-e491103d-297c-42d6-8135-c192e7016967 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1599 microversion: 2.20 time: 0.217248 Aug 24 17:54:02.770730 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 374/746] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:02 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:54:02.793884 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ecc409e9-5eea-4813-95d5-016c858d29bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:02.794816 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ecc409e9-5eea-4813-95d5-016c858d29bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:02.801166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ecc409e9-5eea-4813-95d5-016c858d29bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:02.801942 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ecc409e9-5eea-4813-95d5-016c858d29bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:02.802571 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ecc409e9-5eea-4813-95d5-016c858d29bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:02.803448 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ecc409e9-5eea-4813-95d5-016c858d29bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:02.804068 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ecc409e9-5eea-4813-95d5-016c858d29bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:02.805222 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ecc409e9-5eea-4813-95d5-016c858d29bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:02.912692 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ecc409e9-5eea-4813-95d5-016c858d29bc tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.122962 Aug 24 17:54:02.913640 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 375/747] 10.222.0.76 () {60 vars in 1316 bytes} [Wed Aug 24 17:54:02 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:54:04.080803 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-332718df-5eae-4f1b-acf8-2f0443977f6c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "POST /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.621632 Aug 24 17:54:04.082033 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 373/748] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 17:54:02 2022] POST /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/os-volume_attachments => generated 194 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:04.328147 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-6bcaf73f-b861-4940-b973-a56b3f83ed49 req-9365cafd-0c8c-426f-ab5e-8603faae71e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "861f638b-1bdf-459e-bf10-2846d8994ac4", "tag": "83c659e2-8827-4402-9131-6edb2b9b0a44"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:04.338346 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-6bcaf73f-b861-4940-b973-a56b3f83ed49 req-9365cafd-0c8c-426f-ab5e-8603faae71e8 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:04.339508 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-6bcaf73f-b861-4940-b973-a56b3f83ed49 req-9365cafd-0c8c-426f-ab5e-8603faae71e8 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:04.340245 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-6bcaf73f-b861-4940-b973-a56b3f83ed49 req-9365cafd-0c8c-426f-ab5e-8603faae71e8 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:04.372566 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:04.372566 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-6bcaf73f-b861-4940-b973-a56b3f83ed49 req-9365cafd-0c8c-426f-ab5e-8603faae71e8 service nova] Creating event network-changed:83c659e2-8827-4402-9131-6edb2b9b0a44 for instance 861f638b-1bdf-459e-bf10-2846d8994ac4 on hv-cinder-85442 Aug 24 17:54:04.372566 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-6bcaf73f-b861-4940-b973-a56b3f83ed49 req-9365cafd-0c8c-426f-ab5e-8603faae71e8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038859 Aug 24 17:54:04.372566 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 376/749] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:05.124383 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8b4eb327-f9af-4b50-88fc-58294616a88a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:05.124973 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8b4eb327-f9af-4b50-88fc-58294616a88a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:05.127104 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:05.132375 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8b4eb327-f9af-4b50-88fc-58294616a88a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:05.132865 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8b4eb327-f9af-4b50-88fc-58294616a88a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:05.133309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8b4eb327-f9af-4b50-88fc-58294616a88a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:05.134042 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8b4eb327-f9af-4b50-88fc-58294616a88a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:05.134502 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8b4eb327-f9af-4b50-88fc-58294616a88a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:05.134929 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8b4eb327-f9af-4b50-88fc-58294616a88a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:05.141929 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:05.164810 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8b4eb327-f9af-4b50-88fc-58294616a88a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Going to try to terminate instance {{(pid=127676) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:54:05.563227 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-8b4eb327-f9af-4b50-88fc-58294616a88a tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "DELETE /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 204 len: 0 microversion: 2.1 time: 0.443773 Aug 24 17:54:05.563740 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 374/750] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:54:05 2022] DELETE /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:54:05.579914 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-69784ab9-b540-4ddc-b2ff-69770a1051b0 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:05.580627 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-69784ab9-b540-4ddc-b2ff-69770a1051b0 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:05.587990 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-69784ab9-b540-4ddc-b2ff-69770a1051b0 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:05.588527 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-69784ab9-b540-4ddc-b2ff-69770a1051b0 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:05.589022 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-69784ab9-b540-4ddc-b2ff-69770a1051b0 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:05.589993 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-69784ab9-b540-4ddc-b2ff-69770a1051b0 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:05.590430 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-69784ab9-b540-4ddc-b2ff-69770a1051b0 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:05.590862 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-69784ab9-b540-4ddc-b2ff-69770a1051b0 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:05.874229 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-69784ab9-b540-4ddc-b2ff-69770a1051b0 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:05.882200 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-69784ab9-b540-4ddc-b2ff-69770a1051b0 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 200 len: 1514 microversion: 2.1 time: 0.307105 Aug 24 17:54:05.882780 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 377/751] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:05 2022] GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 1514 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:06.908590 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b2b4cbe1-b197-4230-b733-68e00e1403a5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:06.909432 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-b2b4cbe1-b197-4230-b733-68e00e1403a5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:06.918661 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b2b4cbe1-b197-4230-b733-68e00e1403a5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:06.918887 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b2b4cbe1-b197-4230-b733-68e00e1403a5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:06.919334 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b2b4cbe1-b197-4230-b733-68e00e1403a5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:06.920068 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b2b4cbe1-b197-4230-b733-68e00e1403a5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:06.920558 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b2b4cbe1-b197-4230-b733-68e00e1403a5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:06.921035 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b2b4cbe1-b197-4230-b733-68e00e1403a5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:07.130234 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b2b4cbe1-b197-4230-b733-68e00e1403a5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:07.139149 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b2b4cbe1-b197-4230-b733-68e00e1403a5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 200 len: 1514 microversion: 2.1 time: 0.238143 Aug 24 17:54:07.139752 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 375/752] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:06 2022] GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 1514 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:08.162568 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-42c14756-e11e-4ce0-88f7-399efe436c68 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:08.163257 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-42c14756-e11e-4ce0-88f7-399efe436c68 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:08.170688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-42c14756-e11e-4ce0-88f7-399efe436c68 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:08.171191 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-42c14756-e11e-4ce0-88f7-399efe436c68 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:08.171631 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-42c14756-e11e-4ce0-88f7-399efe436c68 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:08.172343 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-42c14756-e11e-4ce0-88f7-399efe436c68 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:08.172803 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-42c14756-e11e-4ce0-88f7-399efe436c68 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:08.173230 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-42c14756-e11e-4ce0-88f7-399efe436c68 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:08.314611 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-42c14756-e11e-4ce0-88f7-399efe436c68 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:08.322891 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-42c14756-e11e-4ce0-88f7-399efe436c68 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 200 len: 1514 microversion: 2.1 time: 0.164718 Aug 24 17:54:08.323513 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 378/753] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:08 2022] GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:08.526893 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-70c06cc0-afcb-41e9-941b-acbd7188a4d9 req-c3c45e71-02a8-4f91-9cde-fb9a11a02c7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04727389-f440-431a-83b1-12243a4dcfde", "name": "network-vif-deleted", "tag": "4e6bc539-f420-470c-b1db-ab601c29c5a5"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:08.537432 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-70c06cc0-afcb-41e9-941b-acbd7188a4d9 req-c3c45e71-02a8-4f91-9cde-fb9a11a02c7a service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:08.538041 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-70c06cc0-afcb-41e9-941b-acbd7188a4d9 req-c3c45e71-02a8-4f91-9cde-fb9a11a02c7a service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:08.538482 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-70c06cc0-afcb-41e9-941b-acbd7188a4d9 req-c3c45e71-02a8-4f91-9cde-fb9a11a02c7a service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:08.551604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-70c06cc0-afcb-41e9-941b-acbd7188a4d9 req-c3c45e71-02a8-4f91-9cde-fb9a11a02c7a service nova] Creating event network-vif-deleted:4e6bc539-f420-470c-b1db-ab601c29c5a5 for instance 04727389-f440-431a-83b1-12243a4dcfde on hv-cinder-85442 Aug 24 17:54:08.556830 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-70c06cc0-afcb-41e9-941b-acbd7188a4d9 req-c3c45e71-02a8-4f91-9cde-fb9a11a02c7a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034452 Aug 24 17:54:08.557720 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 376/754] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:09.345304 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e77c7940-9cd3-4e0e-8380-12fc7f8ff828 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:09.346032 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-e77c7940-9cd3-4e0e-8380-12fc7f8ff828 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:09.352705 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e77c7940-9cd3-4e0e-8380-12fc7f8ff828 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:09.353298 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e77c7940-9cd3-4e0e-8380-12fc7f8ff828 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:09.353745 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e77c7940-9cd3-4e0e-8380-12fc7f8ff828 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:09.354507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e77c7940-9cd3-4e0e-8380-12fc7f8ff828 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:09.354940 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e77c7940-9cd3-4e0e-8380-12fc7f8ff828 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:09.355360 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e77c7940-9cd3-4e0e-8380-12fc7f8ff828 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:09.393279 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e77c7940-9cd3-4e0e-8380-12fc7f8ff828 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:09.393763 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e77c7940-9cd3-4e0e-8380-12fc7f8ff828 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:09.395071 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e77c7940-9cd3-4e0e-8380-12fc7f8ff828 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:09.395071 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-e77c7940-9cd3-4e0e-8380-12fc7f8ff828 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lazy-loading 'fault' on Instance uuid 04727389-f440-431a-83b1-12243a4dcfde {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:54:09.439571 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e77c7940-9cd3-4e0e-8380-12fc7f8ff828 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca82f3632bc404691835a2db6167939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa9fd072c704af2950a9bb4339d374d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:09.448315 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-e77c7940-9cd3-4e0e-8380-12fc7f8ff828 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 200 len: 1309 microversion: 2.1 time: 0.106330 Aug 24 17:54:09.449289 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 379/755] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:09 2022] GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:10.472887 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-9e93daf4-3b80-40b8-8745-68dc94d3b4d5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:10.473613 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-9e93daf4-3b80-40b8-8745-68dc94d3b4d5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] [instance: 04727389-f440-431a-83b1-12243a4dcfde] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:10.482237 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9e93daf4-3b80-40b8-8745-68dc94d3b4d5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:10.482616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9e93daf4-3b80-40b8-8745-68dc94d3b4d5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:10.483054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9e93daf4-3b80-40b8-8745-68dc94d3b4d5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:10.483770 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9e93daf4-3b80-40b8-8745-68dc94d3b4d5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:10.484226 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9e93daf4-3b80-40b8-8745-68dc94d3b4d5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:10.484655 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9e93daf4-3b80-40b8-8745-68dc94d3b4d5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:10.499384 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-9e93daf4-3b80-40b8-8745-68dc94d3b4d5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] HTTP exception thrown: Instance 04727389-f440-431a-83b1-12243a4dcfde could not be found. Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-9e93daf4-3b80-40b8-8745-68dc94d3b4d5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Request method failure captured: Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde HTTP/1.1 Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmUgVAAMfG-TwMRCZqm69P8UbJ8WXUkGlT6Vhulm-Ql_Lqqu1BR4kups93f61yYEn0h29xSU7hSAJeK4gLFE-Fzq3ZEYcj_bZVEll9w_OANHfN-g3Y8nRNGuAQdGk8-wBkqwLH7dUAIVon7804zalDxcIFSCj4MbDRlx9YVnzCRYE9s Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 4fa9fd072c704af2950a9bb4339d374d Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1554740344 Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:54:10.501054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:54:10.505400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/4fa9fd072c704af2950a9bb4339d374d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4fa9fd072c704af2950a9bb4339d374d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_4fa9fd072c704af2950a9bb4339d374d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/4fa9fd072c704af2950a9bb4339d374d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:54:10.505400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-VolumesSnapshotTestJSON-1554740344 Aug 24 17:54:10.505400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 4fa9fd072c704af2950a9bb4339d374d Aug 24 17:54:10.505400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1554740344 Aug 24 17:54:10.505400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-VolumesSnapshotTestJSON-1554740344-project Aug 24 17:54:10.505400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:54:10.505400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:54:10.505400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 7ca82f3632bc404691835a2db6167939 Aug 24 17:54:10.505400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-VolumesSnapshotTestJSON-1554740344-project Aug 24 17:54:10.505400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:54:10.505400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance 04727389-f440-431a-83b1-12243a4dcfde could not be found. Aug 24 17:54:10.505400 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': '04727389-f440-431a-83b1-12243a4dcfde'} Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04727389-f440-431a-83b1-12243a4dcfde could not be found. Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:54:10.506300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:54:10.508272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:54:10.508272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:54:10.508272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:54:10.508272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:54:10.508272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:54:10.508272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:54:10.508272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:54:10.508272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04727389-f440-431a-83b1-12243a4dcfde could not be found. Aug 24 17:54:10.508272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:54:10.508272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:10.508272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:54:10.508272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:10.508272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:10.508272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:10.508272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:54:10.508272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:54:10.508272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04727389-f440-431a-83b1-12243a4dcfde could not be found. Aug 24 17:54:10.508272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:54:10.509555 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-9e93daf4-3b80-40b8-8745-68dc94d3b4d5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] Returning 404 to user: Instance 04727389-f440-431a-83b1-12243a4dcfde could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:54:10.509555 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-9e93daf4-3b80-40b8-8745-68dc94d3b4d5 tempest-VolumesSnapshotTestJSON-1554740344 tempest-VolumesSnapshotTestJSON-1554740344-project] 10.222.0.76 "GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde" status: 404 len: 111 microversion: 2.1 time: 0.034640 Aug 24 17:54:10.509555 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 377/756] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:10 2022] GET /compute/v2.1/servers/04727389-f440-431a-83b1-12243a4dcfde => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:54:12.811508 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-af03c398-8dce-4e48-90f4-8494cc019c4c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:12.813792 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-af03c398-8dce-4e48-90f4-8494cc019c4c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:12.820671 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-af03c398-8dce-4e48-90f4-8494cc019c4c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:12.821161 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-af03c398-8dce-4e48-90f4-8494cc019c4c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:12.821600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-af03c398-8dce-4e48-90f4-8494cc019c4c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:12.822325 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-af03c398-8dce-4e48-90f4-8494cc019c4c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:12.822781 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-af03c398-8dce-4e48-90f4-8494cc019c4c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:12.823206 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-af03c398-8dce-4e48-90f4-8494cc019c4c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:12.847521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-af03c398-8dce-4e48-90f4-8494cc019c4c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lazy-loading 'flavor' on Instance uuid d27bf857-8c45-4e91-b69c-a5ff394f502b {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:54:13.188624 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-af03c398-8dce-4e48-90f4-8494cc019c4c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "POST /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/action" status: 200 len: 32 microversion: 2.1 time: 0.382019 Aug 24 17:54:13.189310 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 380/757] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 17:54:12 2022] POST /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/action => generated 32 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:54:13.199178 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f2d7decd-dbd6-4fce-8a00-c5feadddf665 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:13.200062 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f2d7decd-dbd6-4fce-8a00-c5feadddf665 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:13.206424 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f2d7decd-dbd6-4fce-8a00-c5feadddf665 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:13.206914 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f2d7decd-dbd6-4fce-8a00-c5feadddf665 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:13.207357 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f2d7decd-dbd6-4fce-8a00-c5feadddf665 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:13.208142 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f2d7decd-dbd6-4fce-8a00-c5feadddf665 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:13.208521 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f2d7decd-dbd6-4fce-8a00-c5feadddf665 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:13.209058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f2d7decd-dbd6-4fce-8a00-c5feadddf665 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:13.365137 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f2d7decd-dbd6-4fce-8a00-c5feadddf665 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:13.374141 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f2d7decd-dbd6-4fce-8a00-c5feadddf665 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1735 microversion: 2.1 time: 0.179204 Aug 24 17:54:13.374727 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 378/758] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:13 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:14.395328 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3dba8529-60a0-4809-9d4e-ec2bbeb0e598 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:14.396075 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3dba8529-60a0-4809-9d4e-ec2bbeb0e598 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:14.403395 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3dba8529-60a0-4809-9d4e-ec2bbeb0e598 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:14.403887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3dba8529-60a0-4809-9d4e-ec2bbeb0e598 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:14.404473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3dba8529-60a0-4809-9d4e-ec2bbeb0e598 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:14.405035 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3dba8529-60a0-4809-9d4e-ec2bbeb0e598 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:14.405491 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3dba8529-60a0-4809-9d4e-ec2bbeb0e598 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:14.405950 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3dba8529-60a0-4809-9d4e-ec2bbeb0e598 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:14.541829 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3dba8529-60a0-4809-9d4e-ec2bbeb0e598 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:14.551448 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3dba8529-60a0-4809-9d4e-ec2bbeb0e598 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1735 microversion: 2.1 time: 0.160336 Aug 24 17:54:14.552034 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 381/759] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:14 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:15.574486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-33905a55-27cf-4953-8d19-126f9dae4182 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:15.575218 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-33905a55-27cf-4953-8d19-126f9dae4182 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:15.581823 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-33905a55-27cf-4953-8d19-126f9dae4182 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:15.582397 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-33905a55-27cf-4953-8d19-126f9dae4182 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:15.582833 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-33905a55-27cf-4953-8d19-126f9dae4182 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:15.583586 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-33905a55-27cf-4953-8d19-126f9dae4182 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:15.584044 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-33905a55-27cf-4953-8d19-126f9dae4182 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:15.584522 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-33905a55-27cf-4953-8d19-126f9dae4182 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:15.728366 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-33905a55-27cf-4953-8d19-126f9dae4182 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:15.737913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-33905a55-27cf-4953-8d19-126f9dae4182 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1735 microversion: 2.1 time: 0.167656 Aug 24 17:54:15.738656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 379/760] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:15 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:16.759982 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d1a2f277-5a44-4449-a50a-2513b9381143 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:16.760595 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d1a2f277-5a44-4449-a50a-2513b9381143 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:16.763978 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:16.768861 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d1a2f277-5a44-4449-a50a-2513b9381143 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:16.769348 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d1a2f277-5a44-4449-a50a-2513b9381143 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:16.769795 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d1a2f277-5a44-4449-a50a-2513b9381143 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:16.770525 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d1a2f277-5a44-4449-a50a-2513b9381143 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:16.770986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d1a2f277-5a44-4449-a50a-2513b9381143 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:16.771676 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d1a2f277-5a44-4449-a50a-2513b9381143 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:16.912035 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d1a2f277-5a44-4449-a50a-2513b9381143 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:16.924060 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d1a2f277-5a44-4449-a50a-2513b9381143 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1735 microversion: 2.1 time: 0.167984 Aug 24 17:54:16.924889 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 382/761] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:16 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:17.945561 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0049880f-83bc-407d-9689-a239022411f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:17.946138 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0049880f-83bc-407d-9689-a239022411f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:17.953584 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0049880f-83bc-407d-9689-a239022411f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:17.954104 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0049880f-83bc-407d-9689-a239022411f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:17.954650 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0049880f-83bc-407d-9689-a239022411f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:17.955338 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0049880f-83bc-407d-9689-a239022411f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:17.955799 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0049880f-83bc-407d-9689-a239022411f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:17.956254 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0049880f-83bc-407d-9689-a239022411f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:18.101777 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0049880f-83bc-407d-9689-a239022411f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:18.110565 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0049880f-83bc-407d-9689-a239022411f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1735 microversion: 2.1 time: 0.169157 Aug 24 17:54:18.111137 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 380/762] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:17 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:19.128190 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-2771a93f-ed3b-4ee3-87f7-7b7f4965ff79 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:19.130478 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-2771a93f-ed3b-4ee3-87f7-7b7f4965ff79 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:19.133056 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-54230f7c-9706-4820-b80b-98f4a79a401f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:19.133704 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-54230f7c-9706-4820-b80b-98f4a79a401f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:19.137204 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2771a93f-ed3b-4ee3-87f7-7b7f4965ff79 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:19.137714 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2771a93f-ed3b-4ee3-87f7-7b7f4965ff79 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:19.140920 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2771a93f-ed3b-4ee3-87f7-7b7f4965ff79 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:19.140920 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2771a93f-ed3b-4ee3-87f7-7b7f4965ff79 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:19.140920 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2771a93f-ed3b-4ee3-87f7-7b7f4965ff79 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:19.140920 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2771a93f-ed3b-4ee3-87f7-7b7f4965ff79 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:19.141368 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-54230f7c-9706-4820-b80b-98f4a79a401f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:19.141876 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-54230f7c-9706-4820-b80b-98f4a79a401f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:19.142321 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-54230f7c-9706-4820-b80b-98f4a79a401f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:19.143019 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-54230f7c-9706-4820-b80b-98f4a79a401f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:19.143470 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-54230f7c-9706-4820-b80b-98f4a79a401f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:19.143902 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-54230f7c-9706-4820-b80b-98f4a79a401f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:19.174823 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-2771a93f-ed3b-4ee3-87f7-7b7f4965ff79 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050588 Aug 24 17:54:19.175717 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 383/763] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:54:19 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 17:54:19.242949 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ceadfb18-a60c-4be0-a58d-2c5d162da74c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:19.243555 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ceadfb18-a60c-4be0-a58d-2c5d162da74c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:19.249778 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ceadfb18-a60c-4be0-a58d-2c5d162da74c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:19.250324 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ceadfb18-a60c-4be0-a58d-2c5d162da74c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:19.250766 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ceadfb18-a60c-4be0-a58d-2c5d162da74c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:19.251467 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ceadfb18-a60c-4be0-a58d-2c5d162da74c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:19.251932 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ceadfb18-a60c-4be0-a58d-2c5d162da74c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:19.252361 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ceadfb18-a60c-4be0-a58d-2c5d162da74c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:19.279473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ceadfb18-a60c-4be0-a58d-2c5d162da74c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Going to try to terminate instance {{(pid=127677) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:54:19.285452 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-54230f7c-9706-4820-b80b-98f4a79a401f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:19.293918 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-54230f7c-9706-4820-b80b-98f4a79a401f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1735 microversion: 2.1 time: 0.164976 Aug 24 17:54:19.294571 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 381/764] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:19 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:19.631178 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ceadfb18-a60c-4be0-a58d-2c5d162da74c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 204 len: 0 microversion: 2.1 time: 0.391854 Aug 24 17:54:19.631700 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 384/765] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:54:19 2022] DELETE /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:54:19.640744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-357a999c-055e-470b-bc14-88f6acdfdb6e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:19.641359 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-357a999c-055e-470b-bc14-88f6acdfdb6e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:19.647845 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-357a999c-055e-470b-bc14-88f6acdfdb6e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:19.648300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-357a999c-055e-470b-bc14-88f6acdfdb6e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:19.648760 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-357a999c-055e-470b-bc14-88f6acdfdb6e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:19.649493 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-357a999c-055e-470b-bc14-88f6acdfdb6e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:19.650076 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-357a999c-055e-470b-bc14-88f6acdfdb6e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:19.650509 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-357a999c-055e-470b-bc14-88f6acdfdb6e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:19.823592 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-357a999c-055e-470b-bc14-88f6acdfdb6e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:19.831697 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-357a999c-055e-470b-bc14-88f6acdfdb6e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1672 microversion: 2.1 time: 0.195526 Aug 24 17:54:19.832267 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 382/766] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:19 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1672 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:20.316201 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9bb403ed-d338-4a4e-b0b6-f49cbe9e3215 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:20.317108 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9bb403ed-d338-4a4e-b0b6-f49cbe9e3215 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:20.324036 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9bb403ed-d338-4a4e-b0b6-f49cbe9e3215 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:20.324531 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9bb403ed-d338-4a4e-b0b6-f49cbe9e3215 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:20.324969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9bb403ed-d338-4a4e-b0b6-f49cbe9e3215 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:20.325700 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9bb403ed-d338-4a4e-b0b6-f49cbe9e3215 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:20.326196 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9bb403ed-d338-4a4e-b0b6-f49cbe9e3215 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:20.326777 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9bb403ed-d338-4a4e-b0b6-f49cbe9e3215 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:20.474679 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9bb403ed-d338-4a4e-b0b6-f49cbe9e3215 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:20.485633 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9bb403ed-d338-4a4e-b0b6-f49cbe9e3215 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1735 microversion: 2.1 time: 0.173717 Aug 24 17:54:20.486521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 385/767] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:20 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:20.855842 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b7785069-210a-4d48-a50a-9366166632e1 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:20.856451 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-b7785069-210a-4d48-a50a-9366166632e1 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:20.863294 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b7785069-210a-4d48-a50a-9366166632e1 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:20.863786 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b7785069-210a-4d48-a50a-9366166632e1 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:20.864226 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b7785069-210a-4d48-a50a-9366166632e1 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:20.864932 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b7785069-210a-4d48-a50a-9366166632e1 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:20.865389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b7785069-210a-4d48-a50a-9366166632e1 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:20.865817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b7785069-210a-4d48-a50a-9366166632e1 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:21.003786 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b7785069-210a-4d48-a50a-9366166632e1 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:21.011644 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b7785069-210a-4d48-a50a-9366166632e1 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1672 microversion: 2.1 time: 0.159863 Aug 24 17:54:21.012209 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 383/768] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:20 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:21.506965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4e68a7fd-8694-405a-8a23-1b5fc5cfd597 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:21.507572 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4e68a7fd-8694-405a-8a23-1b5fc5cfd597 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:21.513917 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4e68a7fd-8694-405a-8a23-1b5fc5cfd597 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:21.514469 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4e68a7fd-8694-405a-8a23-1b5fc5cfd597 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:21.514915 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4e68a7fd-8694-405a-8a23-1b5fc5cfd597 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:21.515617 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4e68a7fd-8694-405a-8a23-1b5fc5cfd597 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:21.516083 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4e68a7fd-8694-405a-8a23-1b5fc5cfd597 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:21.516572 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4e68a7fd-8694-405a-8a23-1b5fc5cfd597 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:21.662550 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-4e68a7fd-8694-405a-8a23-1b5fc5cfd597 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:21.671774 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-4e68a7fd-8694-405a-8a23-1b5fc5cfd597 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1735 microversion: 2.1 time: 0.169143 Aug 24 17:54:21.672335 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 386/769] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:21 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:22.036061 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-1b67b61a-f9c9-478e-ac7b-1a8d510cab62 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:22.037642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-1b67b61a-f9c9-478e-ac7b-1a8d510cab62 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:22.044772 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1b67b61a-f9c9-478e-ac7b-1a8d510cab62 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:22.045267 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1b67b61a-f9c9-478e-ac7b-1a8d510cab62 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:22.045718 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1b67b61a-f9c9-478e-ac7b-1a8d510cab62 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:22.046487 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1b67b61a-f9c9-478e-ac7b-1a8d510cab62 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:22.046950 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1b67b61a-f9c9-478e-ac7b-1a8d510cab62 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:22.047415 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1b67b61a-f9c9-478e-ac7b-1a8d510cab62 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:22.187433 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-1b67b61a-f9c9-478e-ac7b-1a8d510cab62 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:22.197103 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-1b67b61a-f9c9-478e-ac7b-1a8d510cab62 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1672 microversion: 2.1 time: 0.165103 Aug 24 17:54:22.197691 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 384/770] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:22 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:22.693270 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a138ef0a-32d6-4c4e-886b-f32bfa72c4fd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:22.697003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a138ef0a-32d6-4c4e-886b-f32bfa72c4fd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:22.701960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a138ef0a-32d6-4c4e-886b-f32bfa72c4fd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:22.702592 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a138ef0a-32d6-4c4e-886b-f32bfa72c4fd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:22.703036 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a138ef0a-32d6-4c4e-886b-f32bfa72c4fd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:22.703745 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a138ef0a-32d6-4c4e-886b-f32bfa72c4fd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:22.704207 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a138ef0a-32d6-4c4e-886b-f32bfa72c4fd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:22.704633 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a138ef0a-32d6-4c4e-886b-f32bfa72c4fd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:22.849400 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a138ef0a-32d6-4c4e-886b-f32bfa72c4fd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:22.859596 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a138ef0a-32d6-4c4e-886b-f32bfa72c4fd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1735 microversion: 2.1 time: 0.170637 Aug 24 17:54:22.860180 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 387/771] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:22 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:22.973993 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-b91a233b-67c0-41b2-97cd-2a2dff741313 req-5b80cb62-3a5d-4568-a402-b6e04d19cc22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec9a988c-b152-4e39-ad48-c2f7facd203f", "name": "network-vif-deleted", "tag": "d93fe402-2e98-4ff9-8441-854219d9e667"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:22.985363 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-b91a233b-67c0-41b2-97cd-2a2dff741313 req-5b80cb62-3a5d-4568-a402-b6e04d19cc22 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:22.986151 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-b91a233b-67c0-41b2-97cd-2a2dff741313 req-5b80cb62-3a5d-4568-a402-b6e04d19cc22 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:22.986686 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-b91a233b-67c0-41b2-97cd-2a2dff741313 req-5b80cb62-3a5d-4568-a402-b6e04d19cc22 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:23.009261 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-b91a233b-67c0-41b2-97cd-2a2dff741313 req-5b80cb62-3a5d-4568-a402-b6e04d19cc22 service nova] Creating event network-vif-deleted:d93fe402-2e98-4ff9-8441-854219d9e667 for instance ec9a988c-b152-4e39-ad48-c2f7facd203f on hv-cinder-85442 Aug 24 17:54:23.014535 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-b91a233b-67c0-41b2-97cd-2a2dff741313 req-5b80cb62-3a5d-4568-a402-b6e04d19cc22 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044257 Aug 24 17:54:23.015248 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 385/772] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:23.463070 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f0b76a4b-a752-447e-9adf-7ef83fd6c6e0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:23.464159 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-f0b76a4b-a752-447e-9adf-7ef83fd6c6e0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:23.470810 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f0b76a4b-a752-447e-9adf-7ef83fd6c6e0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:23.471303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f0b76a4b-a752-447e-9adf-7ef83fd6c6e0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:23.471739 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f0b76a4b-a752-447e-9adf-7ef83fd6c6e0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:23.472446 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f0b76a4b-a752-447e-9adf-7ef83fd6c6e0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:23.472909 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f0b76a4b-a752-447e-9adf-7ef83fd6c6e0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:23.473334 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f0b76a4b-a752-447e-9adf-7ef83fd6c6e0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:23.539104 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f0b76a4b-a752-447e-9adf-7ef83fd6c6e0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:23.547862 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-f0b76a4b-a752-447e-9adf-7ef83fd6c6e0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1606 microversion: 2.1 time: 0.332819 Aug 24 17:54:23.548550 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 388/773] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:23 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1606 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:23.883148 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7fdbdee6-c22d-4ed7-8133-07959abeb09a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:23.883838 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7fdbdee6-c22d-4ed7-8133-07959abeb09a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:23.891314 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7fdbdee6-c22d-4ed7-8133-07959abeb09a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:23.891807 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7fdbdee6-c22d-4ed7-8133-07959abeb09a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:23.893535 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7fdbdee6-c22d-4ed7-8133-07959abeb09a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:23.895379 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7fdbdee6-c22d-4ed7-8133-07959abeb09a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:23.896153 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7fdbdee6-c22d-4ed7-8133-07959abeb09a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:23.896606 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7fdbdee6-c22d-4ed7-8133-07959abeb09a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:24.050442 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7fdbdee6-c22d-4ed7-8133-07959abeb09a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:24.060849 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7fdbdee6-c22d-4ed7-8133-07959abeb09a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1735 microversion: 2.1 time: 0.181983 Aug 24 17:54:24.061437 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 386/774] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:23 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:24.570926 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a05953e8-bda2-423c-b6af-8c01a1886728 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:24.571595 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a05953e8-bda2-423c-b6af-8c01a1886728 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:24.579080 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a05953e8-bda2-423c-b6af-8c01a1886728 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:24.579568 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a05953e8-bda2-423c-b6af-8c01a1886728 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:24.580002 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a05953e8-bda2-423c-b6af-8c01a1886728 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:24.580702 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a05953e8-bda2-423c-b6af-8c01a1886728 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:24.581156 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a05953e8-bda2-423c-b6af-8c01a1886728 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:24.581584 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a05953e8-bda2-423c-b6af-8c01a1886728 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:24.601452 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:24.651336 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a05953e8-bda2-423c-b6af-8c01a1886728 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:24.660367 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a05953e8-bda2-423c-b6af-8c01a1886728 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1606 microversion: 2.1 time: 0.093239 Aug 24 17:54:24.661051 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 389/775] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:24 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1606 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:25.082133 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-86484c10-24da-4e52-9a42-133b354a80a0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:25.082759 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-86484c10-24da-4e52-9a42-133b354a80a0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:25.089421 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-86484c10-24da-4e52-9a42-133b354a80a0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:25.090068 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-86484c10-24da-4e52-9a42-133b354a80a0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:25.090516 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-86484c10-24da-4e52-9a42-133b354a80a0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:25.091489 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-86484c10-24da-4e52-9a42-133b354a80a0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:25.091933 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-86484c10-24da-4e52-9a42-133b354a80a0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:25.092367 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-86484c10-24da-4e52-9a42-133b354a80a0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:25.233143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-86484c10-24da-4e52-9a42-133b354a80a0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:25.241814 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-86484c10-24da-4e52-9a42-133b354a80a0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1735 microversion: 2.1 time: 0.163456 Aug 24 17:54:25.242433 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 387/776] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:25 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:25.682131 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-6a943c4a-8078-4d3e-9029-a86b3be5cd25 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:25.682738 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-6a943c4a-8078-4d3e-9029-a86b3be5cd25 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:25.690025 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6a943c4a-8078-4d3e-9029-a86b3be5cd25 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:25.690517 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6a943c4a-8078-4d3e-9029-a86b3be5cd25 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:25.690957 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6a943c4a-8078-4d3e-9029-a86b3be5cd25 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:25.691745 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6a943c4a-8078-4d3e-9029-a86b3be5cd25 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:25.692202 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6a943c4a-8078-4d3e-9029-a86b3be5cd25 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:25.692632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6a943c4a-8078-4d3e-9029-a86b3be5cd25 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:25.728356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6a943c4a-8078-4d3e-9029-a86b3be5cd25 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:25.728845 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6a943c4a-8078-4d3e-9029-a86b3be5cd25 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:25.729289 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6a943c4a-8078-4d3e-9029-a86b3be5cd25 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:25.729743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-6a943c4a-8078-4d3e-9029-a86b3be5cd25 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lazy-loading 'fault' on Instance uuid ec9a988c-b152-4e39-ad48-c2f7facd203f {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:54:25.773476 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-6a943c4a-8078-4d3e-9029-a86b3be5cd25 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:25.784143 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-6a943c4a-8078-4d3e-9029-a86b3be5cd25 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 200 len: 1327 microversion: 2.1 time: 0.106380 Aug 24 17:54:25.784727 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 390/777] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:25 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:26.263702 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-569c5b80-6750-4807-9b04-8f3f9073ee87 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:26.264394 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-569c5b80-6750-4807-9b04-8f3f9073ee87 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:26.271071 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-569c5b80-6750-4807-9b04-8f3f9073ee87 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:26.271548 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-569c5b80-6750-4807-9b04-8f3f9073ee87 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:26.272012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-569c5b80-6750-4807-9b04-8f3f9073ee87 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:26.272674 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-569c5b80-6750-4807-9b04-8f3f9073ee87 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:26.273125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-569c5b80-6750-4807-9b04-8f3f9073ee87 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:26.273549 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-569c5b80-6750-4807-9b04-8f3f9073ee87 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:26.406577 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-569c5b80-6750-4807-9b04-8f3f9073ee87 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:26.415367 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-569c5b80-6750-4807-9b04-8f3f9073ee87 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1735 microversion: 2.1 time: 0.155991 Aug 24 17:54:26.416266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 388/778] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:26 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:26.808149 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0fb5c563-b40a-408f-9fe6-60bc49a9633e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:26.808871 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0fb5c563-b40a-408f-9fe6-60bc49a9633e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:26.816495 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0fb5c563-b40a-408f-9fe6-60bc49a9633e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:26.816991 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0fb5c563-b40a-408f-9fe6-60bc49a9633e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:26.817460 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0fb5c563-b40a-408f-9fe6-60bc49a9633e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:26.818218 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0fb5c563-b40a-408f-9fe6-60bc49a9633e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:26.818676 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0fb5c563-b40a-408f-9fe6-60bc49a9633e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:26.819105 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0fb5c563-b40a-408f-9fe6-60bc49a9633e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:26.834252 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-0fb5c563-b40a-408f-9fe6-60bc49a9633e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] HTTP exception thrown: Instance ec9a988c-b152-4e39-ad48-c2f7facd203f could not be found. Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0fb5c563-b40a-408f-9fe6-60bc49a9633e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Request method failure captured: Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f HTTP/1.1 Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmShO0WCIT-ieTC0TkC22s2NgbPlbfYeqpu6ROdq8R33p7FSdk6nRhMJ93KK-8IHs5QOrFvm_sEVfOUeogXN52RInGKn0Kxp-2OpFT2Jgz_XZ06W7SW8L7lfFPi06ojVje3oQHlU_gM4OkbLVA2s3lIWcHbQTzatflVFkFwfj3nFjlg Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 40256802535d4aedb2541246a687ec76 Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-AttachVolumeTestJSON-66162385 Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:54:26.835931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:54:26.838388 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/40256802535d4aedb2541246a687ec76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/40256802535d4aedb2541246a687ec76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_40256802535d4aedb2541246a687ec76", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/40256802535d4aedb2541246a687ec76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:54:26.838388 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-AttachVolumeTestJSON-66162385 Aug 24 17:54:26.838388 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 40256802535d4aedb2541246a687ec76 Aug 24 17:54:26.838388 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-AttachVolumeTestJSON-66162385 Aug 24 17:54:26.838388 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-AttachVolumeTestJSON-66162385-project Aug 24 17:54:26.838388 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:54:26.838388 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:54:26.838388 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: 2b6b0d0cbdb54a46a7e9d6936c47cc4c Aug 24 17:54:26.838388 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-AttachVolumeTestJSON-66162385-project Aug 24 17:54:26.838388 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:54:26.838388 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance ec9a988c-b152-4e39-ad48-c2f7facd203f could not be found. Aug 24 17:54:26.838388 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': 'ec9a988c-b152-4e39-ad48-c2f7facd203f'} Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec9a988c-b152-4e39-ad48-c2f7facd203f could not be found. Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:54:26.840254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:54:26.844114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:54:26.844114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:54:26.844114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:54:26.844114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:54:26.844114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:54:26.844114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:54:26.844114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:54:26.844114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec9a988c-b152-4e39-ad48-c2f7facd203f could not be found. Aug 24 17:54:26.844114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:54:26.844114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:26.844114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:54:26.844114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:26.844114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:26.844114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:26.844114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:54:26.844114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:54:26.844114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec9a988c-b152-4e39-ad48-c2f7facd203f could not be found. Aug 24 17:54:26.844114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:54:26.845238 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0fb5c563-b40a-408f-9fe6-60bc49a9633e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Returning 404 to user: Instance ec9a988c-b152-4e39-ad48-c2f7facd203f could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:54:26.845238 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0fb5c563-b40a-408f-9fe6-60bc49a9633e tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 404 len: 111 microversion: 2.1 time: 0.033891 Aug 24 17:54:26.845238 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 391/779] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:26 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:54:26.847670 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b8f6fbbe-6083-4120-aea9-18f3a44dd594 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '.version_select at 0x7fce7735fd30>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:26.946571 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b8f6fbbe-6083-4120-aea9-18f3a44dd594 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380642430" status: 202 len: 0 microversion: 2.1 time: 0.102801 Aug 24 17:54:26.947411 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 389/780] 10.222.0.76 () {58 vars in 1221 bytes} [Wed Aug 24 17:54:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380642430 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:54:27.439270 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0f743c54-1241-49ad-a874-196ddb3f8ada tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:27.439788 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0f743c54-1241-49ad-a874-196ddb3f8ada tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:27.446170 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0f743c54-1241-49ad-a874-196ddb3f8ada tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:27.446670 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0f743c54-1241-49ad-a874-196ddb3f8ada tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:27.447110 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0f743c54-1241-49ad-a874-196ddb3f8ada tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:27.447811 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0f743c54-1241-49ad-a874-196ddb3f8ada tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:27.448268 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0f743c54-1241-49ad-a874-196ddb3f8ada tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:27.448699 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0f743c54-1241-49ad-a874-196ddb3f8ada tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:27.587372 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0f743c54-1241-49ad-a874-196ddb3f8ada tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:27.596270 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0f743c54-1241-49ad-a874-196ddb3f8ada tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1735 microversion: 2.1 time: 0.161411 Aug 24 17:54:27.596829 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 392/781] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:27 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:27.735142 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-1c78be34-dda5-44cb-9349-3baa8ba1329a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Action: 'create', calling method: .version_select at 0x7fce77398280>, body: {"keypair": {"name": "tempest-keypair-1152614609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRLXRp1AEN6SzSBkANv9ruhiJy0IHMo0Tv/7Nt+EH1ntNRe0maXSbWhGccn2yJnpVfZku4YXY9cVubaaZdeH1Z+ACUmbAH1S3Vx2PYR9pino6EGa6DETdIR/B/glPQUng=="}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:27.751904 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-1c78be34-dda5-44cb-9349-3baa8ba1329a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Getting quotas for project 40256802535d4aedb2541246a687ec76. Resources: {'key_pairs'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:54:27.755734 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-1c78be34-dda5-44cb-9349-3baa8ba1329a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Getting quotas for user 2b6b0d0cbdb54a46a7e9d6936c47cc4c and project 40256802535d4aedb2541246a687ec76. Resources: {'key_pairs'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:54:27.837895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-1c78be34-dda5-44cb-9349-3baa8ba1329a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107393 Aug 24 17:54:27.838511 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 390/782] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 17:54:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:28.616833 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-6b8126b6-ea8f-4fcd-87db-f4ce6a81cb24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:28.617525 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-6b8126b6-ea8f-4fcd-87db-f4ce6a81cb24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:28.625155 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6b8126b6-ea8f-4fcd-87db-f4ce6a81cb24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:28.625664 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6b8126b6-ea8f-4fcd-87db-f4ce6a81cb24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:28.626138 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6b8126b6-ea8f-4fcd-87db-f4ce6a81cb24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:28.626836 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6b8126b6-ea8f-4fcd-87db-f4ce6a81cb24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:28.627293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6b8126b6-ea8f-4fcd-87db-f4ce6a81cb24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:28.627718 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6b8126b6-ea8f-4fcd-87db-f4ce6a81cb24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:28.765766 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-6b8126b6-ea8f-4fcd-87db-f4ce6a81cb24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:28.775132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-6b8126b6-ea8f-4fcd-87db-f4ce6a81cb24 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1735 microversion: 2.1 time: 0.162223 Aug 24 17:54:28.775706 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 393/783] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:28 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:29.797765 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-58401ce1-2d15-4d3e-bd8b-2a14bf906111 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:29.799096 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-58401ce1-2d15-4d3e-bd8b-2a14bf906111 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:29.805500 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58401ce1-2d15-4d3e-bd8b-2a14bf906111 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:29.806035 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58401ce1-2d15-4d3e-bd8b-2a14bf906111 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:29.806478 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58401ce1-2d15-4d3e-bd8b-2a14bf906111 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:29.807191 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58401ce1-2d15-4d3e-bd8b-2a14bf906111 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:29.807648 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58401ce1-2d15-4d3e-bd8b-2a14bf906111 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:29.808074 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-58401ce1-2d15-4d3e-bd8b-2a14bf906111 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:29.946581 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-58401ce1-2d15-4d3e-bd8b-2a14bf906111 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:29.960043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-58401ce1-2d15-4d3e-bd8b-2a14bf906111 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1735 microversion: 2.1 time: 0.164770 Aug 24 17:54:29.960043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 391/784] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:29 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:30.495939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a39a25a8-865a-4ea9-b59d-4109757b4396 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1452846952", "imageRef": "2d76d745-abc6-4a7b-b8d7-46566b66934b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "389a41b1-7bca-4893-9c00-f7c2a36844c1"}], "security_groups": [{"name": "tempest-securitygroup--120337858"}], "key_name": "tempest-keypair-1152614609", "user_data": "}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:30.612974 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.network.neutron [None req-a39a25a8-865a-4ea9-b59d-4109757b4396 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] validate_networks() for [('389a41b1-7bca-4893-9c00-f7c2a36844c1', None, None, None, None, None)] {{(pid=127677) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:54:30.978839 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-47c8fd36-e4d6-4be8-a095-9c913d0a9455 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:30.979474 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-47c8fd36-e4d6-4be8-a095-9c913d0a9455 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:30.986780 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-47c8fd36-e4d6-4be8-a095-9c913d0a9455 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:30.987357 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-47c8fd36-e4d6-4be8-a095-9c913d0a9455 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:30.987796 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-47c8fd36-e4d6-4be8-a095-9c913d0a9455 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:30.988521 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-47c8fd36-e4d6-4be8-a095-9c913d0a9455 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:30.988976 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-47c8fd36-e4d6-4be8-a095-9c913d0a9455 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:30.989402 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-47c8fd36-e4d6-4be8-a095-9c913d0a9455 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:31.172206 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-a39a25a8-865a-4ea9-b59d-4109757b4396 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Flavor limits 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:54:31.172633 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-a39a25a8-865a-4ea9-b59d-4109757b4396 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Image limits 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:54:31.173106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-a39a25a8-865a-4ea9-b59d-4109757b4396 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Flavor pref 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:54:31.173515 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-a39a25a8-865a-4ea9-b59d-4109757b4396 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Image pref 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:54:31.173952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-a39a25a8-865a-4ea9-b59d-4109757b4396 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:54:31.183206 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a39a25a8-865a-4ea9-b59d-4109757b4396 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:31.183681 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a39a25a8-865a-4ea9-b59d-4109757b4396 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:31.184114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a39a25a8-865a-4ea9-b59d-4109757b4396 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:31.184842 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a39a25a8-865a-4ea9-b59d-4109757b4396 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:31.185291 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a39a25a8-865a-4ea9-b59d-4109757b4396 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:31.186157 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a39a25a8-865a-4ea9-b59d-4109757b4396 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:31.199326 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-47c8fd36-e4d6-4be8-a095-9c913d0a9455 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:31.207808 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-a39a25a8-865a-4ea9-b59d-4109757b4396 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Getting quotas for project 40256802535d4aedb2541246a687ec76. Resources: {'instances', 'ram', 'cores'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:54:31.208832 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-47c8fd36-e4d6-4be8-a095-9c913d0a9455 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1735 microversion: 2.1 time: 0.233948 Aug 24 17:54:31.210489 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 392/785] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:30 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:31.212332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-a39a25a8-865a-4ea9-b59d-4109757b4396 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Getting quotas for user 2b6b0d0cbdb54a46a7e9d6936c47cc4c and project 40256802535d4aedb2541246a687ec76. Resources: {'instances', 'ram', 'cores'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:54:31.225222 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a39a25a8-865a-4ea9-b59d-4109757b4396 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Going to run 1 instances... {{(pid=127677) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:54:31.227687 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a39a25a8-865a-4ea9-b59d-4109757b4396 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d76d745-abc6-4a7b-b8d7-46566b66934b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:54:31.431266 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a39a25a8-865a-4ea9-b59d-4109757b4396 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.942788 Aug 24 17:54:31.431767 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 394/786] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 17:54:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:54:31.443243 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-691c0acd-425c-46ac-8c6e-0f792effa232 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:31.443865 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-691c0acd-425c-46ac-8c6e-0f792effa232 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:31.500607 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-691c0acd-425c-46ac-8c6e-0f792effa232 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:31.507522 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-691c0acd-425c-46ac-8c6e-0f792effa232 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1238 microversion: 2.1 time: 0.068134 Aug 24 17:54:31.508099 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 393/787] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:31 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:32.232126 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-792170e1-f5b4-472c-a094-c5572192d8a5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:32.236591 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-792170e1-f5b4-472c-a094-c5572192d8a5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:32.240540 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-792170e1-f5b4-472c-a094-c5572192d8a5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:32.241034 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-792170e1-f5b4-472c-a094-c5572192d8a5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:32.241474 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-792170e1-f5b4-472c-a094-c5572192d8a5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:32.242215 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-792170e1-f5b4-472c-a094-c5572192d8a5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:32.242676 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-792170e1-f5b4-472c-a094-c5572192d8a5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:32.243095 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-792170e1-f5b4-472c-a094-c5572192d8a5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:32.387022 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-792170e1-f5b4-472c-a094-c5572192d8a5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:32.402398 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-792170e1-f5b4-472c-a094-c5572192d8a5 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1735 microversion: 2.1 time: 0.174463 Aug 24 17:54:32.403896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 395/788] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:32 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:32.530016 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-fab3db89-fce2-4a50-92e3-b63b54e22848 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:32.530583 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-fab3db89-fce2-4a50-92e3-b63b54e22848 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:32.537705 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fab3db89-fce2-4a50-92e3-b63b54e22848 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:32.555503 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fab3db89-fce2-4a50-92e3-b63b54e22848 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:32.555503 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fab3db89-fce2-4a50-92e3-b63b54e22848 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:32.555503 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fab3db89-fce2-4a50-92e3-b63b54e22848 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:32.555503 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fab3db89-fce2-4a50-92e3-b63b54e22848 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:32.555904 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fab3db89-fce2-4a50-92e3-b63b54e22848 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:32.555904 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:32.602749 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-fab3db89-fce2-4a50-92e3-b63b54e22848 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:32.612165 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-fab3db89-fce2-4a50-92e3-b63b54e22848 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1242 microversion: 2.1 time: 0.086798 Aug 24 17:54:32.612740 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 394/789] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:32 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:33.424948 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0ba1d28e-f01d-4db9-9fa7-fd00d1c2eefd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:33.425606 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0ba1d28e-f01d-4db9-9fa7-fd00d1c2eefd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:33.432160 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0ba1d28e-f01d-4db9-9fa7-fd00d1c2eefd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:33.432649 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0ba1d28e-f01d-4db9-9fa7-fd00d1c2eefd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:33.433092 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0ba1d28e-f01d-4db9-9fa7-fd00d1c2eefd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:33.433881 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0ba1d28e-f01d-4db9-9fa7-fd00d1c2eefd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:33.434358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0ba1d28e-f01d-4db9-9fa7-fd00d1c2eefd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:33.434787 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0ba1d28e-f01d-4db9-9fa7-fd00d1c2eefd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:33.576891 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0ba1d28e-f01d-4db9-9fa7-fd00d1c2eefd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:33.585443 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0ba1d28e-f01d-4db9-9fa7-fd00d1c2eefd tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1735 microversion: 2.1 time: 0.164431 Aug 24 17:54:33.586055 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 396/790] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:33 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:33.634278 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-2aa28794-ac0b-4826-be6f-b1df7a5f1f56 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:33.634892 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-2aa28794-ac0b-4826-be6f-b1df7a5f1f56 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:33.643131 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2aa28794-ac0b-4826-be6f-b1df7a5f1f56 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:33.645348 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2aa28794-ac0b-4826-be6f-b1df7a5f1f56 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:33.645348 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2aa28794-ac0b-4826-be6f-b1df7a5f1f56 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:33.645348 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2aa28794-ac0b-4826-be6f-b1df7a5f1f56 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:33.645348 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2aa28794-ac0b-4826-be6f-b1df7a5f1f56 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:33.646021 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2aa28794-ac0b-4826-be6f-b1df7a5f1f56 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:33.722247 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-2aa28794-ac0b-4826-be6f-b1df7a5f1f56 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:33.730372 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-2aa28794-ac0b-4826-be6f-b1df7a5f1f56 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1290 microversion: 2.1 time: 0.099870 Aug 24 17:54:33.730938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 395/791] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:33 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1290 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:34.608451 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-2e1bfcf6-97f9-43b1-b98d-23e12ac5c850 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:34.609040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-2e1bfcf6-97f9-43b1-b98d-23e12ac5c850 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:34.615527 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2e1bfcf6-97f9-43b1-b98d-23e12ac5c850 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:34.616012 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2e1bfcf6-97f9-43b1-b98d-23e12ac5c850 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:34.616507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2e1bfcf6-97f9-43b1-b98d-23e12ac5c850 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:34.617179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2e1bfcf6-97f9-43b1-b98d-23e12ac5c850 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:34.617632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2e1bfcf6-97f9-43b1-b98d-23e12ac5c850 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:34.618112 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2e1bfcf6-97f9-43b1-b98d-23e12ac5c850 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:34.754231 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-4597b060-4147-4043-aa31-2ced3a2718a9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:34.754833 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4597b060-4147-4043-aa31-2ced3a2718a9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:34.764677 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-2e1bfcf6-97f9-43b1-b98d-23e12ac5c850 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:34.766137 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4597b060-4147-4043-aa31-2ced3a2718a9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:34.766448 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4597b060-4147-4043-aa31-2ced3a2718a9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:34.773055 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4597b060-4147-4043-aa31-2ced3a2718a9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:34.773055 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4597b060-4147-4043-aa31-2ced3a2718a9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:34.773055 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4597b060-4147-4043-aa31-2ced3a2718a9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:34.773055 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4597b060-4147-4043-aa31-2ced3a2718a9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:34.775895 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-2e1bfcf6-97f9-43b1-b98d-23e12ac5c850 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1715 microversion: 2.1 time: 0.171887 Aug 24 17:54:34.790069 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 397/792] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:34 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1715 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:34.856246 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-4597b060-4147-4043-aa31-2ced3a2718a9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:34.869680 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-4597b060-4147-4043-aa31-2ced3a2718a9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1298 microversion: 2.1 time: 0.119339 Aug 24 17:54:34.870325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 396/793] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:34 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:34.933233 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-24733f7e-cb13-40d7-8825-40d54eb61998 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:34.933757 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-24733f7e-cb13-40d7-8825-40d54eb61998 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:34.940555 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-24733f7e-cb13-40d7-8825-40d54eb61998 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:34.941037 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-24733f7e-cb13-40d7-8825-40d54eb61998 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:34.941476 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-24733f7e-cb13-40d7-8825-40d54eb61998 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:34.942259 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-24733f7e-cb13-40d7-8825-40d54eb61998 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:34.942720 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-24733f7e-cb13-40d7-8825-40d54eb61998 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:34.943151 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-24733f7e-cb13-40d7-8825-40d54eb61998 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:35.040085 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-24733f7e-cb13-40d7-8825-40d54eb61998 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] HTTP exception thrown: Cannot 'detach_volume' instance d27bf857-8c45-4e91-b69c-a5ff394f502b while it is in vm_state rescued Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-24733f7e-cb13-40d7-8825-40d54eb61998 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Request method failure captured: Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: DELETE /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/os-volume_attachments/ee355dd0-4818-44f6-a8a2-c31f104d6bf0 HTTP/1.1 Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmT-a9KYb466OD5Drv3Xz81qZyGQfXkbOB6dEp6k723KOUCx26OY7I-Uf1faS7dYmQ0QJhOLKeYvP_LQ2isazwrorVarlgJCG3lZ3XKvf8uWsndZrl9kdWhNBejxIoqjEkYfxmZxCfSO2IVsERdDLdkIV3PCifqVzvgcWT1JLc6EnfM Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 151e9d2b290047e8acd9468c721b9dd3 Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1512152156 Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:54:35.041632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:54:35.044294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/151e9d2b290047e8acd9468c721b9dd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/151e9d2b290047e8acd9468c721b9dd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_151e9d2b290047e8acd9468c721b9dd3", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/151e9d2b290047e8acd9468c721b9dd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:54:35.044294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1512152156 Aug 24 17:54:35.044294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 151e9d2b290047e8acd9468c721b9dd3 Aug 24 17:54:35.044294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1512152156 Aug 24 17:54:35.044294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-ServerRescueNegativeTestJSON-1512152156-project Aug 24 17:54:35.044294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:54:35.044294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:54:35.044294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: 63ff0ea67ee64e14aafc5c51cad9684f Aug 24 17:54:35.044294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1512152156-project Aug 24 17:54:35.044294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:54:35.044294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Cannot 'detach_volume' instance d27bf857-8c45-4e91-b69c-a5ff394f502b while it is in vm_state rescued Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'server_id': 'd27bf857-8c45-4e91-b69c-a5ff394f502b', 'id': 'ee355dd0-4818-44f6-a8a2-c31f104d6bf0'} Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d27bf857-8c45-4e91-b69c-a5ff394f502b in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:54:35.050921 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:54:35.053284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 17:54:35.053284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 17:54:35.053284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 17:54:35.053284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 17:54:35.053284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d27bf857-8c45-4e91-b69c-a5ff394f502b while it is in vm_state rescued Aug 24 17:54:35.053284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:54:35.053284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:35.053284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:54:35.053284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:35.053284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:35.053284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:35.053284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:54:35.053284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:54:35.053284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d27bf857-8c45-4e91-b69c-a5ff394f502b while it is in vm_state rescued Aug 24 17:54:35.053284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:54:35.053284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-24733f7e-cb13-40d7-8825-40d54eb61998 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Returning 409 to user: Cannot 'detach_volume' instance d27bf857-8c45-4e91-b69c-a5ff394f502b while it is in vm_state rescued {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:54:35.055596 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-24733f7e-cb13-40d7-8825-40d54eb61998 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/os-volume_attachments/ee355dd0-4818-44f6-a8a2-c31f104d6bf0" status: 409 len: 152 microversion: 2.1 time: 0.113915 Aug 24 17:54:35.055596 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 398/794] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 17:54:34 2022] DELETE /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/os-volume_attachments/ee355dd0-4818-44f6-a8a2-c31f104d6bf0 => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 17:54:35.057934 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f18d955f-6e52-4c35-acd4-c92c5dc17a35 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:35.058489 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f18d955f-6e52-4c35-acd4-c92c5dc17a35 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:35.065815 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f18d955f-6e52-4c35-acd4-c92c5dc17a35 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:35.066366 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f18d955f-6e52-4c35-acd4-c92c5dc17a35 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:35.066808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f18d955f-6e52-4c35-acd4-c92c5dc17a35 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:35.067522 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f18d955f-6e52-4c35-acd4-c92c5dc17a35 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:35.067986 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f18d955f-6e52-4c35-acd4-c92c5dc17a35 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:35.068417 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f18d955f-6e52-4c35-acd4-c92c5dc17a35 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:35.337380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f18d955f-6e52-4c35-acd4-c92c5dc17a35 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "POST /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/action" status: 202 len: 0 microversion: 2.1 time: 0.283422 Aug 24 17:54:35.341212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 397/795] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 17:54:35 2022] POST /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:54:35.346934 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-6ca47272-5e90-4a9f-915a-abc7479fedae tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:35.347551 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-6ca47272-5e90-4a9f-915a-abc7479fedae tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:35.353919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6ca47272-5e90-4a9f-915a-abc7479fedae tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:35.354744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6ca47272-5e90-4a9f-915a-abc7479fedae tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:35.355595 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6ca47272-5e90-4a9f-915a-abc7479fedae tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:35.356319 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6ca47272-5e90-4a9f-915a-abc7479fedae tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:35.356786 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6ca47272-5e90-4a9f-915a-abc7479fedae tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:35.357927 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6ca47272-5e90-4a9f-915a-abc7479fedae tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:35.529452 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-6ca47272-5e90-4a9f-915a-abc7479fedae tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:35.539126 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-6ca47272-5e90-4a9f-915a-abc7479fedae tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1723 microversion: 2.1 time: 0.195932 Aug 24 17:54:35.539979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 399/796] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:35 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:35.896722 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-874821c8-1a77-4fe6-8f44-fd93f998cfce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:35.897209 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-874821c8-1a77-4fe6-8f44-fd93f998cfce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:35.904961 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-874821c8-1a77-4fe6-8f44-fd93f998cfce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:35.905946 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-874821c8-1a77-4fe6-8f44-fd93f998cfce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:35.906642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-874821c8-1a77-4fe6-8f44-fd93f998cfce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:35.907527 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-874821c8-1a77-4fe6-8f44-fd93f998cfce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:35.908212 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-874821c8-1a77-4fe6-8f44-fd93f998cfce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:35.908868 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-874821c8-1a77-4fe6-8f44-fd93f998cfce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:36.160427 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-874821c8-1a77-4fe6-8f44-fd93f998cfce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:36.172267 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-874821c8-1a77-4fe6-8f44-fd93f998cfce tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1363 microversion: 2.1 time: 0.280415 Aug 24 17:54:36.180784 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 398/797] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:35 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:36.512814 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-2951cdbb-c1db-45d2-854d-6cdbb9656825 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:36.514332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-2951cdbb-c1db-45d2-854d-6cdbb9656825 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:36.520620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2951cdbb-c1db-45d2-854d-6cdbb9656825 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:36.521219 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2951cdbb-c1db-45d2-854d-6cdbb9656825 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:36.521661 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2951cdbb-c1db-45d2-854d-6cdbb9656825 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:36.522589 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2951cdbb-c1db-45d2-854d-6cdbb9656825 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:36.523059 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2951cdbb-c1db-45d2-854d-6cdbb9656825 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:36.523494 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2951cdbb-c1db-45d2-854d-6cdbb9656825 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:36.550375 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-2951cdbb-c1db-45d2-854d-6cdbb9656825 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f/ips" status: 200 len: 150 microversion: 2.1 time: 0.162613 Aug 24 17:54:36.551321 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 400/798] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 24 17:54:36 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f/ips => generated 150 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:36.565420 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b11f9546-af14-4239-b392-d7d52a5e88c3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:36.566137 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-b11f9546-af14-4239-b392-d7d52a5e88c3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:36.573374 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b11f9546-af14-4239-b392-d7d52a5e88c3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:36.573898 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b11f9546-af14-4239-b392-d7d52a5e88c3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:36.574340 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b11f9546-af14-4239-b392-d7d52a5e88c3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:36.575042 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b11f9546-af14-4239-b392-d7d52a5e88c3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:36.575495 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b11f9546-af14-4239-b392-d7d52a5e88c3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:36.576585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b11f9546-af14-4239-b392-d7d52a5e88c3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:36.745075 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b11f9546-af14-4239-b392-d7d52a5e88c3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:36.760083 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b11f9546-af14-4239-b392-d7d52a5e88c3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1723 microversion: 2.1 time: 0.199030 Aug 24 17:54:36.760677 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 399/799] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:36 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:36.865725 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-5c9fd044-7b70-4203-ba07-0ef48077fb41 req-a27cbf64-fa64-447b-b551-0f689e63930c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c778621a-6f96-42dd-926e-a398bb219880", "tag": "9763e972-34e4-4117-87ff-40626f7974b5"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:36.876191 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-5c9fd044-7b70-4203-ba07-0ef48077fb41 req-a27cbf64-fa64-447b-b551-0f689e63930c service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:36.876667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-5c9fd044-7b70-4203-ba07-0ef48077fb41 req-a27cbf64-fa64-447b-b551-0f689e63930c service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:36.877094 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-5c9fd044-7b70-4203-ba07-0ef48077fb41 req-a27cbf64-fa64-447b-b551-0f689e63930c service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:36.894251 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-5c9fd044-7b70-4203-ba07-0ef48077fb41 req-a27cbf64-fa64-447b-b551-0f689e63930c service nova] Creating event network-changed:9763e972-34e4-4117-87ff-40626f7974b5 for instance c778621a-6f96-42dd-926e-a398bb219880 on hv-cinder-85442 Aug 24 17:54:36.899817 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-5c9fd044-7b70-4203-ba07-0ef48077fb41 req-a27cbf64-fa64-447b-b551-0f689e63930c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098181 Aug 24 17:54:36.900507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 401/800] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:37.203322 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-04fa7e2f-03ce-4166-ae9f-080ee6b80384 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:37.203990 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-04fa7e2f-03ce-4166-ae9f-080ee6b80384 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:37.206403 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:37.212021 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-04fa7e2f-03ce-4166-ae9f-080ee6b80384 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:37.212516 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-04fa7e2f-03ce-4166-ae9f-080ee6b80384 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:37.212954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-04fa7e2f-03ce-4166-ae9f-080ee6b80384 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:37.213662 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-04fa7e2f-03ce-4166-ae9f-080ee6b80384 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:37.214232 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-04fa7e2f-03ce-4166-ae9f-080ee6b80384 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:37.214985 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-04fa7e2f-03ce-4166-ae9f-080ee6b80384 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:37.374322 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-04fa7e2f-03ce-4166-ae9f-080ee6b80384 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:37.383906 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-04fa7e2f-03ce-4166-ae9f-080ee6b80384 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1363 microversion: 2.1 time: 0.185101 Aug 24 17:54:37.391228 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 400/801] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:37 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:37.784906 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c092c5fc-9eb7-412c-9e2b-e31897d1785f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:37.785603 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c092c5fc-9eb7-412c-9e2b-e31897d1785f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:37.791848 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c092c5fc-9eb7-412c-9e2b-e31897d1785f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:37.792689 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c092c5fc-9eb7-412c-9e2b-e31897d1785f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:37.793322 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c092c5fc-9eb7-412c-9e2b-e31897d1785f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:37.794057 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c092c5fc-9eb7-412c-9e2b-e31897d1785f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:37.794662 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c092c5fc-9eb7-412c-9e2b-e31897d1785f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:37.795641 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c092c5fc-9eb7-412c-9e2b-e31897d1785f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:38.041806 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c092c5fc-9eb7-412c-9e2b-e31897d1785f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:38.052020 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c092c5fc-9eb7-412c-9e2b-e31897d1785f tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1723 microversion: 2.1 time: 0.270922 Aug 24 17:54:38.052020 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 402/802] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:37 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:38.269709 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-87c68b7f-718e-4271-995f-79158842d139 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17662974-0900-41a9-841b-34d788f6d18b"}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:38.272412 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-87c68b7f-718e-4271-995f-79158842d139 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:38.280162 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-87c68b7f-718e-4271-995f-79158842d139 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:38.285471 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-87c68b7f-718e-4271-995f-79158842d139 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:38.285471 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-87c68b7f-718e-4271-995f-79158842d139 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:38.285471 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-87c68b7f-718e-4271-995f-79158842d139 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:38.285471 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-87c68b7f-718e-4271-995f-79158842d139 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:38.285901 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-87c68b7f-718e-4271-995f-79158842d139 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:38.405895 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a483a178-6a05-464b-8e8d-b0ec5a4c3cec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:38.406505 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a483a178-6a05-464b-8e8d-b0ec5a4c3cec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:38.414071 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a483a178-6a05-464b-8e8d-b0ec5a4c3cec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:38.414814 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a483a178-6a05-464b-8e8d-b0ec5a4c3cec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:38.415428 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a483a178-6a05-464b-8e8d-b0ec5a4c3cec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:38.416711 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a483a178-6a05-464b-8e8d-b0ec5a4c3cec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:38.417579 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a483a178-6a05-464b-8e8d-b0ec5a4c3cec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:38.418294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a483a178-6a05-464b-8e8d-b0ec5a4c3cec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:38.602805 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a483a178-6a05-464b-8e8d-b0ec5a4c3cec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:38.615361 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a483a178-6a05-464b-8e8d-b0ec5a4c3cec tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1363 microversion: 2.1 time: 0.213584 Aug 24 17:54:38.623332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 403/803] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:38 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:39.072945 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-582fbe88-e9aa-4ab5-a76d-9bde20030d06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:39.073626 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-582fbe88-e9aa-4ab5-a76d-9bde20030d06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:39.080958 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-582fbe88-e9aa-4ab5-a76d-9bde20030d06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:39.081447 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-582fbe88-e9aa-4ab5-a76d-9bde20030d06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:39.081924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-582fbe88-e9aa-4ab5-a76d-9bde20030d06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:39.082626 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-582fbe88-e9aa-4ab5-a76d-9bde20030d06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:39.083087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-582fbe88-e9aa-4ab5-a76d-9bde20030d06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:39.083518 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-582fbe88-e9aa-4ab5-a76d-9bde20030d06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:39.189654 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-87c68b7f-718e-4271-995f-79158842d139 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "POST /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.923736 Aug 24 17:54:39.194353 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 401/804] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 17:54:38 2022] POST /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f/os-volume_attachments => generated 194 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:39.239279 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-582fbe88-e9aa-4ab5-a76d-9bde20030d06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:39.249897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-582fbe88-e9aa-4ab5-a76d-9bde20030d06 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1729 microversion: 2.1 time: 0.180486 Aug 24 17:54:39.250310 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 404/805] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:39 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:39.278062 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-1cc77e56-bd32-41ea-8473-2664d18fa143 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:39.278844 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-1cc77e56-bd32-41ea-8473-2664d18fa143 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:39.286146 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1cc77e56-bd32-41ea-8473-2664d18fa143 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:39.286683 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1cc77e56-bd32-41ea-8473-2664d18fa143 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:39.287119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1cc77e56-bd32-41ea-8473-2664d18fa143 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:39.287834 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1cc77e56-bd32-41ea-8473-2664d18fa143 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:39.288353 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1cc77e56-bd32-41ea-8473-2664d18fa143 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:39.289059 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1cc77e56-bd32-41ea-8473-2664d18fa143 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:39.379243 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-1cc77e56-bd32-41ea-8473-2664d18fa143 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105882 Aug 24 17:54:39.379847 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 402/806] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 24 17:54:39 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:39.642922 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-58cfcbcc-a4d1-4a40-ad98-fd9c5db703d8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:39.643449 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-58cfcbcc-a4d1-4a40-ad98-fd9c5db703d8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:39.649760 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-58cfcbcc-a4d1-4a40-ad98-fd9c5db703d8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:39.650284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-58cfcbcc-a4d1-4a40-ad98-fd9c5db703d8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:39.650786 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-58cfcbcc-a4d1-4a40-ad98-fd9c5db703d8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:39.651496 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-58cfcbcc-a4d1-4a40-ad98-fd9c5db703d8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:39.651961 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-58cfcbcc-a4d1-4a40-ad98-fd9c5db703d8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:39.652392 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-58cfcbcc-a4d1-4a40-ad98-fd9c5db703d8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:39.913342 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-58cfcbcc-a4d1-4a40-ad98-fd9c5db703d8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:39.926196 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-58cfcbcc-a4d1-4a40-ad98-fd9c5db703d8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1363 microversion: 2.1 time: 0.287116 Aug 24 17:54:39.937199 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 405/807] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:39 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:40.777060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-befbcd2c-3d69-4d40-a1e2-70bcc3f54eab req-dd860f02-ad9c-42a0-8efd-02617500e225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d27bf857-8c45-4e91-b69c-a5ff394f502b", "tag": "6d25f4e4-bb42-4107-b7a2-69620f7c6955"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:40.794469 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-befbcd2c-3d69-4d40-a1e2-70bcc3f54eab req-dd860f02-ad9c-42a0-8efd-02617500e225 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:40.794469 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-befbcd2c-3d69-4d40-a1e2-70bcc3f54eab req-dd860f02-ad9c-42a0-8efd-02617500e225 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:40.794469 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-befbcd2c-3d69-4d40-a1e2-70bcc3f54eab req-dd860f02-ad9c-42a0-8efd-02617500e225 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:40.804727 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-befbcd2c-3d69-4d40-a1e2-70bcc3f54eab req-dd860f02-ad9c-42a0-8efd-02617500e225 service nova] Creating event network-changed:6d25f4e4-bb42-4107-b7a2-69620f7c6955 for instance d27bf857-8c45-4e91-b69c-a5ff394f502b on hv-cinder-85442 Aug 24 17:54:40.809584 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-befbcd2c-3d69-4d40-a1e2-70bcc3f54eab req-dd860f02-ad9c-42a0-8efd-02617500e225 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037551 Aug 24 17:54:40.810297 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 403/808] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:40.947990 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-2ca2d9f7-7089-4a64-9da2-b0e02bdaa733 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:40.949417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-2ca2d9f7-7089-4a64-9da2-b0e02bdaa733 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:40.957476 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2ca2d9f7-7089-4a64-9da2-b0e02bdaa733 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:40.958005 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2ca2d9f7-7089-4a64-9da2-b0e02bdaa733 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:40.958623 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2ca2d9f7-7089-4a64-9da2-b0e02bdaa733 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:40.959575 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2ca2d9f7-7089-4a64-9da2-b0e02bdaa733 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:40.960212 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2ca2d9f7-7089-4a64-9da2-b0e02bdaa733 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:40.960636 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2ca2d9f7-7089-4a64-9da2-b0e02bdaa733 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:41.130342 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-2ca2d9f7-7089-4a64-9da2-b0e02bdaa733 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:41.140433 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-2ca2d9f7-7089-4a64-9da2-b0e02bdaa733 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1363 microversion: 2.1 time: 0.196793 Aug 24 17:54:41.154677 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 406/809] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:40 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:42.159073 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=6 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:42.164031 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-efa6e93a-9861-4aee-813e-41c3452a80bb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:42.170304 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-efa6e93a-9861-4aee-813e-41c3452a80bb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:42.172573 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-efa6e93a-9861-4aee-813e-41c3452a80bb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:42.173111 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-efa6e93a-9861-4aee-813e-41c3452a80bb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:42.173587 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-efa6e93a-9861-4aee-813e-41c3452a80bb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:42.174434 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-efa6e93a-9861-4aee-813e-41c3452a80bb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:42.174967 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-efa6e93a-9861-4aee-813e-41c3452a80bb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:42.175446 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-efa6e93a-9861-4aee-813e-41c3452a80bb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:42.316899 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-efa6e93a-9861-4aee-813e-41c3452a80bb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:42.326987 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-efa6e93a-9861-4aee-813e-41c3452a80bb tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1363 microversion: 2.1 time: 0.167655 Aug 24 17:54:42.327137 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 404/810] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:42 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:42.825040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-65b619d9-2cda-41e8-9ff1-bdaeb1217166 req-74f4d5bb-736a-4824-a5fb-ed89e14ad81c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d27bf857-8c45-4e91-b69c-a5ff394f502b", "tag": "6d25f4e4-bb42-4107-b7a2-69620f7c6955"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:42.830766 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=2 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:42.831664 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=6 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:42.837557 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-65b619d9-2cda-41e8-9ff1-bdaeb1217166 req-74f4d5bb-736a-4824-a5fb-ed89e14ad81c service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:42.838697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-65b619d9-2cda-41e8-9ff1-bdaeb1217166 req-74f4d5bb-736a-4824-a5fb-ed89e14ad81c service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:42.838697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-65b619d9-2cda-41e8-9ff1-bdaeb1217166 req-74f4d5bb-736a-4824-a5fb-ed89e14ad81c service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:42.851407 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-65b619d9-2cda-41e8-9ff1-bdaeb1217166 req-74f4d5bb-736a-4824-a5fb-ed89e14ad81c service nova] Creating event network-changed:6d25f4e4-bb42-4107-b7a2-69620f7c6955 for instance d27bf857-8c45-4e91-b69c-a5ff394f502b on hv-cinder-85442 Aug 24 17:54:42.857478 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-65b619d9-2cda-41e8-9ff1-bdaeb1217166 req-74f4d5bb-736a-4824-a5fb-ed89e14ad81c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035650 Aug 24 17:54:42.858332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 407/811] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:43.349682 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-c3f30f73-e029-4532-a31b-de12b6749c90 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:43.350729 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-c3f30f73-e029-4532-a31b-de12b6749c90 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:43.359722 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c3f30f73-e029-4532-a31b-de12b6749c90 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:43.360414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c3f30f73-e029-4532-a31b-de12b6749c90 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:43.360866 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c3f30f73-e029-4532-a31b-de12b6749c90 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:43.361632 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c3f30f73-e029-4532-a31b-de12b6749c90 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:43.362143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c3f30f73-e029-4532-a31b-de12b6749c90 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:43.362577 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c3f30f73-e029-4532-a31b-de12b6749c90 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:43.564639 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c3f30f73-e029-4532-a31b-de12b6749c90 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:43.569789 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-c3f30f73-e029-4532-a31b-de12b6749c90 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1363 microversion: 2.1 time: 0.225079 Aug 24 17:54:43.570423 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 405/812] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:43 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:44.594615 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0740e650-db44-49e2-affe-df69025ce5d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:44.595416 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0740e650-db44-49e2-affe-df69025ce5d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:44.603062 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0740e650-db44-49e2-affe-df69025ce5d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:44.603561 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0740e650-db44-49e2-affe-df69025ce5d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:44.604004 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0740e650-db44-49e2-affe-df69025ce5d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:44.604721 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0740e650-db44-49e2-affe-df69025ce5d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:44.605183 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0740e650-db44-49e2-affe-df69025ce5d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:44.605986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0740e650-db44-49e2-affe-df69025ce5d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:44.801877 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0740e650-db44-49e2-affe-df69025ce5d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:44.805481 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=100 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:44.810375 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0740e650-db44-49e2-affe-df69025ce5d9 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1363 microversion: 2.1 time: 0.222384 Aug 24 17:54:44.810955 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 408/813] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:44 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:45.393984 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-15fbd45b-68d4-44fb-8083-79ce2a20c4a1 req-bb6470ba-b217-4941-874f-d6995fe0e2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c778621a-6f96-42dd-926e-a398bb219880", "name": "network-vif-plugged", "status": "completed", "tag": "9763e972-34e4-4117-87ff-40626f7974b5"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:45.405513 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-15fbd45b-68d4-44fb-8083-79ce2a20c4a1 req-bb6470ba-b217-4941-874f-d6995fe0e2d5 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:45.406032 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-15fbd45b-68d4-44fb-8083-79ce2a20c4a1 req-bb6470ba-b217-4941-874f-d6995fe0e2d5 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:45.406467 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-15fbd45b-68d4-44fb-8083-79ce2a20c4a1 req-bb6470ba-b217-4941-874f-d6995fe0e2d5 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:45.418341 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-15fbd45b-68d4-44fb-8083-79ce2a20c4a1 req-bb6470ba-b217-4941-874f-d6995fe0e2d5 service nova] Creating event network-vif-plugged:9763e972-34e4-4117-87ff-40626f7974b5 for instance c778621a-6f96-42dd-926e-a398bb219880 on hv-cinder-85442 Aug 24 17:54:45.423695 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-15fbd45b-68d4-44fb-8083-79ce2a20c4a1 req-bb6470ba-b217-4941-874f-d6995fe0e2d5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033677 Aug 24 17:54:45.424370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 406/814] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:45.840399 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-bd406546-9333-4bbf-8f9d-52d8b1b8c8ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:45.841416 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-bd406546-9333-4bbf-8f9d-52d8b1b8c8ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:45.849587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bd406546-9333-4bbf-8f9d-52d8b1b8c8ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:45.850109 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bd406546-9333-4bbf-8f9d-52d8b1b8c8ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:45.850552 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bd406546-9333-4bbf-8f9d-52d8b1b8c8ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:45.851268 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bd406546-9333-4bbf-8f9d-52d8b1b8c8ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:45.851726 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bd406546-9333-4bbf-8f9d-52d8b1b8c8ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:45.852151 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bd406546-9333-4bbf-8f9d-52d8b1b8c8ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:46.001612 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-bd406546-9333-4bbf-8f9d-52d8b1b8c8ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:46.010024 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-bd406546-9333-4bbf-8f9d-52d8b1b8c8ba tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1363 microversion: 2.1 time: 0.173783 Aug 24 17:54:46.010895 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 409/815] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:45 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:47.033720 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8271c0b5-fd8c-43ef-a1e2-2b03e423292b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:47.034561 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8271c0b5-fd8c-43ef-a1e2-2b03e423292b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:47.041058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8271c0b5-fd8c-43ef-a1e2-2b03e423292b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:47.041539 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8271c0b5-fd8c-43ef-a1e2-2b03e423292b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:47.042009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8271c0b5-fd8c-43ef-a1e2-2b03e423292b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:47.042709 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8271c0b5-fd8c-43ef-a1e2-2b03e423292b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:47.043167 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8271c0b5-fd8c-43ef-a1e2-2b03e423292b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:47.043600 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8271c0b5-fd8c-43ef-a1e2-2b03e423292b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:47.185245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8271c0b5-fd8c-43ef-a1e2-2b03e423292b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:47.193503 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-8271c0b5-fd8c-43ef-a1e2-2b03e423292b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1363 microversion: 2.1 time: 0.165067 Aug 24 17:54:47.194126 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 407/816] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:47 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:47.887412 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ecc2cfa5-6ea7-439b-9473-dd9b340fbb9e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17662974-0900-41a9-841b-34d788f6d18b"}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:47.889805 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ecc2cfa5-6ea7-439b-9473-dd9b340fbb9e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:47.892255 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:47.897294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ecc2cfa5-6ea7-439b-9473-dd9b340fbb9e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:47.897777 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ecc2cfa5-6ea7-439b-9473-dd9b340fbb9e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:47.900284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ecc2cfa5-6ea7-439b-9473-dd9b340fbb9e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:47.900284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ecc2cfa5-6ea7-439b-9473-dd9b340fbb9e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:47.900284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ecc2cfa5-6ea7-439b-9473-dd9b340fbb9e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:47.900284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ecc2cfa5-6ea7-439b-9473-dd9b340fbb9e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:47.997896 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-ecc2cfa5-6ea7-439b-9473-dd9b340fbb9e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] HTTP exception thrown: Invalid volume: volume 17662974-0900-41a9-841b-34d788f6d18b is already attached to instances: ea4c5b83-10ba-4343-a209-f00a509aa20f Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ecc2cfa5-6ea7-439b-9473-dd9b340fbb9e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Request method failure captured: Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: POST /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f/os-volume_attachments HTTP/1.1 Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 74 Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmSbnOSGx7e91Bj6OLQvb6olH3rhtuwbwgCFF2TiEJuGnQyAMTLci2PNua_H1N1Jgo-7CaRuKelcRsW8AHd-7NBHe9Qv1DY7-HELa-jl_G34ACZrF6UPOZU70uNjUu-29pkZxRoJdko5GsGgd7qyf34-jqX4JFHPGtUaryYBDPnp0Vk Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:54:47.999924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:54:48.002673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0a4d7fadea104c569ca29ff9be48089a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:54:48.002673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:54:48.002673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:54:48.002673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:54:48.002673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:54:48.002673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:54:48.002673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:54:48.002673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: 251bc85f89774142a97acd77895b14e9 Aug 24 17:54:48.002673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:54:48.002673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Aug 24 17:54:48.002673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {"volumeAttachment": {"volumeId": "17662974-0900-41a9-841b-34d788f6d18b"}} Aug 24 17:54:48.002673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:54:48.003965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Invalid volume: volume 17662974-0900-41a9-841b-34d788f6d18b is already attached to instances: ea4c5b83-10ba-4343-a209-f00a509aa20f Aug 24 17:54:48.003965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'server_id': 'ea4c5b83-10ba-4343-a209-f00a509aa20f', 'body': {'volumeAttachment': {'volumeId': '17662974-0900-41a9-841b-34d788f6d18b'}}} Aug 24 17:54:48.003965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:54:48.003965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:48.003965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 17:54:48.003965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 17:54:48.003965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 17:54:48.003965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 17:54:48.003965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 17:54:48.003965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 17:54:48.003965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 17:54:48.003965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 17:54:48.003965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 17:54:48.003965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 17:54:48.003965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 17662974-0900-41a9-841b-34d788f6d18b is already attached to instances: ea4c5b83-10ba-4343-a209-f00a509aa20f Aug 24 17:54:48.003965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:54:48.003965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:48.003965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:54:48.003965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 17662974-0900-41a9-841b-34d788f6d18b is already attached to instances: ea4c5b83-10ba-4343-a209-f00a509aa20f Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:48.006040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:48.008331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:48.008331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:54:48.008331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:54:48.008331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 17662974-0900-41a9-841b-34d788f6d18b is already attached to instances: ea4c5b83-10ba-4343-a209-f00a509aa20f Aug 24 17:54:48.008331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:54:48.008331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ecc2cfa5-6ea7-439b-9473-dd9b340fbb9e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Returning 400 to user: Invalid volume: volume 17662974-0900-41a9-841b-34d788f6d18b is already attached to instances: ea4c5b83-10ba-4343-a209-f00a509aa20f {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:54:48.008331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ecc2cfa5-6ea7-439b-9473-dd9b340fbb9e tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "POST /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.118023 Aug 24 17:54:48.008331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 410/817] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 17:54:47 2022] POST /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f/os-volume_attachments => generated 174 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 17:54:48.079137 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-c9451264-dfb2-4860-8d27-24f5ab13f9e7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:48.079137 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-c9451264-dfb2-4860-8d27-24f5ab13f9e7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:48.081334 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c9451264-dfb2-4860-8d27-24f5ab13f9e7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:48.081823 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c9451264-dfb2-4860-8d27-24f5ab13f9e7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:48.086928 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c9451264-dfb2-4860-8d27-24f5ab13f9e7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:48.086928 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c9451264-dfb2-4860-8d27-24f5ab13f9e7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:48.086928 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c9451264-dfb2-4860-8d27-24f5ab13f9e7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:48.086928 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c9451264-dfb2-4860-8d27-24f5ab13f9e7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:48.179148 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-c9451264-dfb2-4860-8d27-24f5ab13f9e7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lazy-loading 'services' on Instance uuid ea4c5b83-10ba-4343-a209-f00a509aa20f {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:54:48.453075 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-41289bf7-9a42-4673-98c3-09a261dece43 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:48.453683 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-41289bf7-9a42-4673-98c3-09a261dece43 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:48.460377 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-41289bf7-9a42-4673-98c3-09a261dece43 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:48.460860 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-41289bf7-9a42-4673-98c3-09a261dece43 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:48.461293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-41289bf7-9a42-4673-98c3-09a261dece43 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:48.462034 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-41289bf7-9a42-4673-98c3-09a261dece43 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:48.462486 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-41289bf7-9a42-4673-98c3-09a261dece43 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:48.462941 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-41289bf7-9a42-4673-98c3-09a261dece43 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:48.474073 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-c9451264-dfb2-4860-8d27-24f5ab13f9e7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f/os-volume_attachments/17662974-0900-41a9-841b-34d788f6d18b" status: 202 len: 0 microversion: 2.1 time: 0.404038 Aug 24 17:54:48.474696 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 408/818] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 17:54:48 2022] DELETE /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f/os-volume_attachments/17662974-0900-41a9-841b-34d788f6d18b => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:54:48.479962 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-027da077-e1cf-4b53-b33c-d7e8752359a8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:48.480686 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-027da077-e1cf-4b53-b33c-d7e8752359a8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:48.487653 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-027da077-e1cf-4b53-b33c-d7e8752359a8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:48.488139 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-027da077-e1cf-4b53-b33c-d7e8752359a8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:48.488571 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-027da077-e1cf-4b53-b33c-d7e8752359a8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:48.489031 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-41289bf7-9a42-4673-98c3-09a261dece43 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4/ips" status: 200 len: 151 microversion: 2.20 time: 0.314050 Aug 24 17:54:48.489275 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-027da077-e1cf-4b53-b33c-d7e8752359a8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:48.489739 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-027da077-e1cf-4b53-b33c-d7e8752359a8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:48.493293 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-027da077-e1cf-4b53-b33c-d7e8752359a8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:48.494115 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 411/819] 10.222.0.76 () {60 vars in 1289 bytes} [Wed Aug 24 17:54:48 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4/ips => generated 151 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:54:48.496777 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a634441c-4a1c-4120-b102-a1b1d5e6a320 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:48.499666 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a634441c-4a1c-4120-b102-a1b1d5e6a320 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:48.506857 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a634441c-4a1c-4120-b102-a1b1d5e6a320 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:48.507787 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a634441c-4a1c-4120-b102-a1b1d5e6a320 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:48.508276 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a634441c-4a1c-4120-b102-a1b1d5e6a320 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:48.509120 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a634441c-4a1c-4120-b102-a1b1d5e6a320 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:48.509642 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a634441c-4a1c-4120-b102-a1b1d5e6a320 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:48.510170 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a634441c-4a1c-4120-b102-a1b1d5e6a320 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:48.513232 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:48.545994 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a634441c-4a1c-4120-b102-a1b1d5e6a320 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054596 Aug 24 17:54:48.546667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 412/820] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:54:48 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:48.646980 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-027da077-e1cf-4b53-b33c-d7e8752359a8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:48.657294 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-027da077-e1cf-4b53-b33c-d7e8752359a8 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1549 microversion: 2.1 time: 0.181300 Aug 24 17:54:48.657890 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 409/821] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:48 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1549 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:48.678337 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-81df057b-61b5-477a-8b6d-9af2032c5fc2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:48.678909 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-81df057b-61b5-477a-8b6d-9af2032c5fc2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:48.685670 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-81df057b-61b5-477a-8b6d-9af2032c5fc2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:48.686281 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-81df057b-61b5-477a-8b6d-9af2032c5fc2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:48.686850 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-81df057b-61b5-477a-8b6d-9af2032c5fc2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:48.687697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-81df057b-61b5-477a-8b6d-9af2032c5fc2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:48.688272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-81df057b-61b5-477a-8b6d-9af2032c5fc2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:48.688707 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-81df057b-61b5-477a-8b6d-9af2032c5fc2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:48.769216 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-81df057b-61b5-477a-8b6d-9af2032c5fc2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095305 Aug 24 17:54:48.770163 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 413/822] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 24 17:54:48 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:49.565705 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-00e27700-c496-4946-b5dd-fd352fbddf45 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:49.569891 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-00e27700-c496-4946-b5dd-fd352fbddf45 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:49.587958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-00e27700-c496-4946-b5dd-fd352fbddf45 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:49.587958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-00e27700-c496-4946-b5dd-fd352fbddf45 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:49.587958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-00e27700-c496-4946-b5dd-fd352fbddf45 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:49.587958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-00e27700-c496-4946-b5dd-fd352fbddf45 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:49.588728 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-00e27700-c496-4946-b5dd-fd352fbddf45 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:49.589549 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-00e27700-c496-4946-b5dd-fd352fbddf45 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:49.645404 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-00e27700-c496-4946-b5dd-fd352fbddf45 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088432 Aug 24 17:54:49.646040 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 410/823] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:54:49 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:50.145502 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-c8eab82a-06fb-43be-83cd-9a2a6443ace3 req-eb027c86-b41d-42ee-80eb-d058689affaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c778621a-6f96-42dd-926e-a398bb219880", "tag": "9763e972-34e4-4117-87ff-40626f7974b5"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:50.170482 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-c8eab82a-06fb-43be-83cd-9a2a6443ace3 req-eb027c86-b41d-42ee-80eb-d058689affaf service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:50.171095 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-c8eab82a-06fb-43be-83cd-9a2a6443ace3 req-eb027c86-b41d-42ee-80eb-d058689affaf service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:50.171382 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-c8eab82a-06fb-43be-83cd-9a2a6443ace3 req-eb027c86-b41d-42ee-80eb-d058689affaf service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:50.186325 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-c8eab82a-06fb-43be-83cd-9a2a6443ace3 req-eb027c86-b41d-42ee-80eb-d058689affaf service nova] Creating event network-changed:9763e972-34e4-4117-87ff-40626f7974b5 for instance c778621a-6f96-42dd-926e-a398bb219880 on hv-cinder-85442 Aug 24 17:54:50.191488 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-c8eab82a-06fb-43be-83cd-9a2a6443ace3 req-eb027c86-b41d-42ee-80eb-d058689affaf service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050358 Aug 24 17:54:50.193030 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 414/824] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:50.661930 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-87439614-3187-4622-baca-9a8bb5d22fe4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:50.666100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-87439614-3187-4622-baca-9a8bb5d22fe4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:50.680866 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-87439614-3187-4622-baca-9a8bb5d22fe4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:50.681792 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-87439614-3187-4622-baca-9a8bb5d22fe4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:50.682633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-87439614-3187-4622-baca-9a8bb5d22fe4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:50.683945 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-87439614-3187-4622-baca-9a8bb5d22fe4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:50.684881 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-87439614-3187-4622-baca-9a8bb5d22fe4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:50.685933 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-87439614-3187-4622-baca-9a8bb5d22fe4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:50.722676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-87439614-3187-4622-baca-9a8bb5d22fe4 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067205 Aug 24 17:54:50.728749 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 411/825] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:54:50 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:54:50.751255 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-61664fec-2ced-4221-a995-31a853616772 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:50.752772 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-61664fec-2ced-4221-a995-31a853616772 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:50.767466 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61664fec-2ced-4221-a995-31a853616772 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:50.768765 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61664fec-2ced-4221-a995-31a853616772 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:50.770161 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61664fec-2ced-4221-a995-31a853616772 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:50.771740 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61664fec-2ced-4221-a995-31a853616772 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:50.772932 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61664fec-2ced-4221-a995-31a853616772 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:50.773968 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-61664fec-2ced-4221-a995-31a853616772 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:50.796449 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-623657bc-8b07-4f9c-88e6-8face10ff9a2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:50.797053 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-623657bc-8b07-4f9c-88e6-8face10ff9a2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:50.803707 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-623657bc-8b07-4f9c-88e6-8face10ff9a2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:50.804403 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-623657bc-8b07-4f9c-88e6-8face10ff9a2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:50.804996 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-623657bc-8b07-4f9c-88e6-8face10ff9a2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:50.805840 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-623657bc-8b07-4f9c-88e6-8face10ff9a2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:50.806441 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-623657bc-8b07-4f9c-88e6-8face10ff9a2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:50.806978 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-623657bc-8b07-4f9c-88e6-8face10ff9a2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:50.840308 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-61664fec-2ced-4221-a995-31a853616772 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lazy-loading 'flavor' on Instance uuid 861f638b-1bdf-459e-bf10-2846d8994ac4 {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:54:50.851547 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-623657bc-8b07-4f9c-88e6-8face10ff9a2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Going to try to terminate instance {{(pid=127676) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:54:51.253544 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-623657bc-8b07-4f9c-88e6-8face10ff9a2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 204 len: 0 microversion: 2.1 time: 0.460671 Aug 24 17:54:51.258182 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 412/826] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:54:50 2022] DELETE /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:54:51.272625 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-08e81928-ab9a-4940-9c92-e882d0628f06 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:51.275668 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-08e81928-ab9a-4940-9c92-e882d0628f06 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:51.284518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-08e81928-ab9a-4940-9c92-e882d0628f06 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:51.286718 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-08e81928-ab9a-4940-9c92-e882d0628f06 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:51.286718 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-08e81928-ab9a-4940-9c92-e882d0628f06 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:51.286718 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-08e81928-ab9a-4940-9c92-e882d0628f06 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:51.286718 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-08e81928-ab9a-4940-9c92-e882d0628f06 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:51.287064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-08e81928-ab9a-4940-9c92-e882d0628f06 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:51.459954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-08e81928-ab9a-4940-9c92-e882d0628f06 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:51.475090 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-08e81928-ab9a-4940-9c92-e882d0628f06 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1678 microversion: 2.1 time: 0.210590 Aug 24 17:54:51.476188 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 413/827] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:51 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:51.574707 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-61664fec-2ced-4221-a995-31a853616772 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "POST /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4/action" status: 202 len: 0 microversion: 2.20 time: 0.831110 Aug 24 17:54:51.576480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 415/828] 10.222.0.76 () {62 vars in 1319 bytes} [Wed Aug 24 17:54:50 2022] POST /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4/action => generated 0 bytes in 833 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:54:51.584372 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-93380e34-293f-4647-a99f-39561ad8e5ed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:51.585003 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-93380e34-293f-4647-a99f-39561ad8e5ed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:51.595514 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-93380e34-293f-4647-a99f-39561ad8e5ed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:51.595514 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-93380e34-293f-4647-a99f-39561ad8e5ed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:51.595514 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-93380e34-293f-4647-a99f-39561ad8e5ed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:51.595514 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-93380e34-293f-4647-a99f-39561ad8e5ed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:51.596146 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-93380e34-293f-4647-a99f-39561ad8e5ed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:51.596146 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-93380e34-293f-4647-a99f-39561ad8e5ed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:51.754103 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-93380e34-293f-4647-a99f-39561ad8e5ed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:51.764251 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-93380e34-293f-4647-a99f-39561ad8e5ed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:51.765797 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-93380e34-293f-4647-a99f-39561ad8e5ed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:51.767067 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-93380e34-293f-4647-a99f-39561ad8e5ed tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1723 microversion: 2.20 time: 0.187082 Aug 24 17:54:51.767631 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 414/829] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:51 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:52.513173 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c9cb5f60-6b73-4639-8f53-a543f3a929e2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:52.514006 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c9cb5f60-6b73-4639-8f53-a543f3a929e2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:52.522306 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9cb5f60-6b73-4639-8f53-a543f3a929e2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:52.522805 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9cb5f60-6b73-4639-8f53-a543f3a929e2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:52.523247 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9cb5f60-6b73-4639-8f53-a543f3a929e2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:52.523963 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9cb5f60-6b73-4639-8f53-a543f3a929e2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:52.524424 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9cb5f60-6b73-4639-8f53-a543f3a929e2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:52.524853 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c9cb5f60-6b73-4639-8f53-a543f3a929e2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:52.684362 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c9cb5f60-6b73-4639-8f53-a543f3a929e2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:52.700968 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c9cb5f60-6b73-4639-8f53-a543f3a929e2 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1678 microversion: 2.1 time: 0.191954 Aug 24 17:54:52.701562 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 416/830] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:52 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:52.792217 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e694ef76-63ef-40f1-9c43-1333caa022af tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:52.792828 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e694ef76-63ef-40f1-9c43-1333caa022af tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:52.799563 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e694ef76-63ef-40f1-9c43-1333caa022af tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:52.800052 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e694ef76-63ef-40f1-9c43-1333caa022af tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:52.800494 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e694ef76-63ef-40f1-9c43-1333caa022af tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:52.801202 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e694ef76-63ef-40f1-9c43-1333caa022af tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:52.801665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e694ef76-63ef-40f1-9c43-1333caa022af tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:52.802131 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e694ef76-63ef-40f1-9c43-1333caa022af tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:52.961730 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e694ef76-63ef-40f1-9c43-1333caa022af tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:52.975614 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e694ef76-63ef-40f1-9c43-1333caa022af tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:52.977215 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e694ef76-63ef-40f1-9c43-1333caa022af tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:52.978516 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e694ef76-63ef-40f1-9c43-1333caa022af tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1723 microversion: 2.20 time: 0.190346 Aug 24 17:54:52.979094 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 415/831] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:52 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:53.728383 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-8ed168a8-f892-4c10-85d8-e74dfefbb881 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:53.729662 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-8ed168a8-f892-4c10-85d8-e74dfefbb881 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:53.743544 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8ed168a8-f892-4c10-85d8-e74dfefbb881 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:53.744612 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8ed168a8-f892-4c10-85d8-e74dfefbb881 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:53.745281 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8ed168a8-f892-4c10-85d8-e74dfefbb881 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:53.747473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8ed168a8-f892-4c10-85d8-e74dfefbb881 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:53.748452 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8ed168a8-f892-4c10-85d8-e74dfefbb881 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:53.749307 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8ed168a8-f892-4c10-85d8-e74dfefbb881 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:53.852097 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-8ed168a8-f892-4c10-85d8-e74dfefbb881 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:53.865682 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-8ed168a8-f892-4c10-85d8-e74dfefbb881 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1614 microversion: 2.1 time: 0.145382 Aug 24 17:54:53.866293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 417/832] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:53 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1614 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:53.911733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-2177965e-5cae-4b34-9084-e1644c2e749e req-83351881-b7c0-4d1d-911a-8aef4bc59685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4c5b83-10ba-4343-a209-f00a509aa20f", "name": "network-vif-deleted", "tag": "df84b545-e21e-40dc-a01c-73704d9d9f09"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:53.923354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-2177965e-5cae-4b34-9084-e1644c2e749e req-83351881-b7c0-4d1d-911a-8aef4bc59685 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:53.925489 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-2177965e-5cae-4b34-9084-e1644c2e749e req-83351881-b7c0-4d1d-911a-8aef4bc59685 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:53.925489 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-2177965e-5cae-4b34-9084-e1644c2e749e req-83351881-b7c0-4d1d-911a-8aef4bc59685 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:53.940595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-2177965e-5cae-4b34-9084-e1644c2e749e req-83351881-b7c0-4d1d-911a-8aef4bc59685 service nova] Creating event network-vif-deleted:df84b545-e21e-40dc-a01c-73704d9d9f09 for instance ea4c5b83-10ba-4343-a209-f00a509aa20f on hv-cinder-85442 Aug 24 17:54:53.946090 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-2177965e-5cae-4b34-9084-e1644c2e749e req-83351881-b7c0-4d1d-911a-8aef4bc59685 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038606 Aug 24 17:54:53.947474 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 416/833] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:54.001285 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e8a3728a-c09c-44bd-8a58-8b22030ae82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:54.002490 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-e8a3728a-c09c-44bd-8a58-8b22030ae82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:54.009348 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e8a3728a-c09c-44bd-8a58-8b22030ae82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:54.009938 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e8a3728a-c09c-44bd-8a58-8b22030ae82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:54.010384 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e8a3728a-c09c-44bd-8a58-8b22030ae82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:54.011320 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e8a3728a-c09c-44bd-8a58-8b22030ae82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:54.012281 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e8a3728a-c09c-44bd-8a58-8b22030ae82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:54.012883 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e8a3728a-c09c-44bd-8a58-8b22030ae82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:54.209471 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e8a3728a-c09c-44bd-8a58-8b22030ae82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:54.226677 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e8a3728a-c09c-44bd-8a58-8b22030ae82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:54.232396 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e8a3728a-c09c-44bd-8a58-8b22030ae82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:54.234276 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-e8a3728a-c09c-44bd-8a58-8b22030ae82c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1723 microversion: 2.20 time: 0.236613 Aug 24 17:54:54.235924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 418/834] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:53 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:54.893880 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-69d3f4a8-2f2b-49ec-b539-d6c37e84a418 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:54.896053 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-69d3f4a8-2f2b-49ec-b539-d6c37e84a418 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:54.908298 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69d3f4a8-2f2b-49ec-b539-d6c37e84a418 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:54.915097 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69d3f4a8-2f2b-49ec-b539-d6c37e84a418 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:54.915097 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69d3f4a8-2f2b-49ec-b539-d6c37e84a418 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:54.915097 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69d3f4a8-2f2b-49ec-b539-d6c37e84a418 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:54.915097 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69d3f4a8-2f2b-49ec-b539-d6c37e84a418 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:54.916419 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69d3f4a8-2f2b-49ec-b539-d6c37e84a418 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:54.982094 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69d3f4a8-2f2b-49ec-b539-d6c37e84a418 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:54.982573 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69d3f4a8-2f2b-49ec-b539-d6c37e84a418 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:54.983008 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-69d3f4a8-2f2b-49ec-b539-d6c37e84a418 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:54.983519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-69d3f4a8-2f2b-49ec-b539-d6c37e84a418 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lazy-loading 'fault' on Instance uuid ea4c5b83-10ba-4343-a209-f00a509aa20f {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:54:55.034627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-69d3f4a8-2f2b-49ec-b539-d6c37e84a418 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:55.049563 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-69d3f4a8-2f2b-49ec-b539-d6c37e84a418 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 200 len: 1331 microversion: 2.1 time: 0.163949 Aug 24 17:54:55.050700 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 417/835] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:54 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 1331 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:55.259550 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-584de6c3-d827-41f0-a868-f788e692b40c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:55.260220 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-584de6c3-d827-41f0-a868-f788e692b40c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:55.267783 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-584de6c3-d827-41f0-a868-f788e692b40c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:55.268269 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-584de6c3-d827-41f0-a868-f788e692b40c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:55.268710 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-584de6c3-d827-41f0-a868-f788e692b40c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:55.269407 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-584de6c3-d827-41f0-a868-f788e692b40c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:55.270150 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-584de6c3-d827-41f0-a868-f788e692b40c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:55.270583 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-584de6c3-d827-41f0-a868-f788e692b40c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:55.418550 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-584de6c3-d827-41f0-a868-f788e692b40c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:55.427243 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-584de6c3-d827-41f0-a868-f788e692b40c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:55.428749 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-584de6c3-d827-41f0-a868-f788e692b40c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:55.429944 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-584de6c3-d827-41f0-a868-f788e692b40c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1723 microversion: 2.20 time: 0.174434 Aug 24 17:54:55.430501 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 419/836] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:55 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:56.075586 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d2b1d36c-e4f7-42f1-83ee-beef9df14900 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:56.076178 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d2b1d36c-e4f7-42f1-83ee-beef9df14900 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:56.082819 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d2b1d36c-e4f7-42f1-83ee-beef9df14900 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:56.083313 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d2b1d36c-e4f7-42f1-83ee-beef9df14900 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:56.083755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d2b1d36c-e4f7-42f1-83ee-beef9df14900 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:56.084461 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d2b1d36c-e4f7-42f1-83ee-beef9df14900 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:56.084922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d2b1d36c-e4f7-42f1-83ee-beef9df14900 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:56.085353 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d2b1d36c-e4f7-42f1-83ee-beef9df14900 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:56.100604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-d2b1d36c-e4f7-42f1-83ee-beef9df14900 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] HTTP exception thrown: Instance ea4c5b83-10ba-4343-a209-f00a509aa20f could not be found. Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d2b1d36c-e4f7-42f1-83ee-beef9df14900 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Request method failure captured: Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f HTTP/1.1 Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmSbnOSGx7e91Bj6OLQvb6olH3rhtuwbwgCFF2TiEJuGnQyAMTLci2PNua_H1N1Jgo-7CaRuKelcRsW8AHd-7NBHe9Qv1DY7-HELa-jl_G34ACZrF6UPOZU70uNjUu-29pkZxRoJdko5GsGgd7qyf34-jqX4JFHPGtUaryYBDPnp0Vk Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:54:56.102307 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:54:56.104858 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0a4d7fadea104c569ca29ff9be48089a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:54:56.104858 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:54:56.104858 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:54:56.104858 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:54:56.104858 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:54:56.104858 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:54:56.104858 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:54:56.104858 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 251bc85f89774142a97acd77895b14e9 Aug 24 17:54:56.104858 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:54:56.104858 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:54:56.104858 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance ea4c5b83-10ba-4343-a209-f00a509aa20f could not be found. Aug 24 17:54:56.104858 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': 'ea4c5b83-10ba-4343-a209-f00a509aa20f'} Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4c5b83-10ba-4343-a209-f00a509aa20f could not be found. Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:54:56.106043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:54:56.109536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:54:56.109536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:54:56.109536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:54:56.109536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:54:56.109536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:54:56.109536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:54:56.109536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:54:56.109536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4c5b83-10ba-4343-a209-f00a509aa20f could not be found. Aug 24 17:54:56.109536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:54:56.109536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:56.109536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:54:56.109536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:56.109536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:56.109536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:56.109536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:54:56.109536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:54:56.109536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4c5b83-10ba-4343-a209-f00a509aa20f could not be found. Aug 24 17:54:56.109536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:54:56.111919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d2b1d36c-e4f7-42f1-83ee-beef9df14900 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Returning 404 to user: Instance ea4c5b83-10ba-4343-a209-f00a509aa20f could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:54:56.111919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d2b1d36c-e4f7-42f1-83ee-beef9df14900 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 404 len: 111 microversion: 2.1 time: 0.033093 Aug 24 17:54:56.111919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 418/837] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:56 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:54:56.115107 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-8acfe279-84ae-48b9-be89-503ef10dd947 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '.version_select at 0x7fce772ec5e0>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:56.218128 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-8acfe279-84ae-48b9-be89-503ef10dd947 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1159583184" status: 202 len: 0 microversion: 2.1 time: 0.108410 Aug 24 17:54:56.218731 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 420/838] 10.222.0.76 () {58 vars in 1221 bytes} [Wed Aug 24 17:54:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1159583184 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:54:56.454311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-c73b79f7-bc30-4bc4-9ff7-411326efcbcd tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:56.454953 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-c73b79f7-bc30-4bc4-9ff7-411326efcbcd tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:56.464241 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c73b79f7-bc30-4bc4-9ff7-411326efcbcd tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:56.464241 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c73b79f7-bc30-4bc4-9ff7-411326efcbcd tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:56.464241 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c73b79f7-bc30-4bc4-9ff7-411326efcbcd tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:56.464241 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c73b79f7-bc30-4bc4-9ff7-411326efcbcd tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:56.464617 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c73b79f7-bc30-4bc4-9ff7-411326efcbcd tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:56.464617 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c73b79f7-bc30-4bc4-9ff7-411326efcbcd tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:56.618597 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c73b79f7-bc30-4bc4-9ff7-411326efcbcd tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:56.630209 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c73b79f7-bc30-4bc4-9ff7-411326efcbcd tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:56.631836 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c73b79f7-bc30-4bc4-9ff7-411326efcbcd tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:56.633118 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-c73b79f7-bc30-4bc4-9ff7-411326efcbcd tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1723 microversion: 2.20 time: 0.183428 Aug 24 17:54:56.633757 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 419/839] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:56 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:57.009378 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0d208e6f-f16a-45eb-81e0-9e61ba8244f5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Action: 'create', calling method: .version_select at 0x7fce7728c820>, body: {"keypair": {"name": "tempest-keypair-1813526352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWWx+NosFXj2H+JXLJs0gX2bDeiYV5DCICsNNAWI77ZewRM8fF/Z1WUbPzmFL/RP7x3oWRssw1NVYwz2tm/xYoALO2I3VqpBQ5tGcD16FiNuMiWEVFISq8VIdu0w3q8Kg=="}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:57.027067 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-0d208e6f-f16a-45eb-81e0-9e61ba8244f5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Getting quotas for project 0a4d7fadea104c569ca29ff9be48089a. Resources: {'key_pairs'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:54:57.032984 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-0d208e6f-f16a-45eb-81e0-9e61ba8244f5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Getting quotas for user 251bc85f89774142a97acd77895b14e9 and project 0a4d7fadea104c569ca29ff9be48089a. Resources: {'key_pairs'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:54:57.117081 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0d208e6f-f16a-45eb-81e0-9e61ba8244f5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.111734 Aug 24 17:54:57.117717 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 421/840] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 17:54:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:57.657078 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7cbd02f3-1e0b-4349-b708-1dcc34110b24 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:57.657727 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7cbd02f3-1e0b-4349-b708-1dcc34110b24 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:57.664527 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7cbd02f3-1e0b-4349-b708-1dcc34110b24 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:57.666042 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7cbd02f3-1e0b-4349-b708-1dcc34110b24 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:57.666042 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7cbd02f3-1e0b-4349-b708-1dcc34110b24 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:57.666308 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7cbd02f3-1e0b-4349-b708-1dcc34110b24 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:57.666768 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7cbd02f3-1e0b-4349-b708-1dcc34110b24 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:57.667191 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7cbd02f3-1e0b-4349-b708-1dcc34110b24 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:57.847359 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7cbd02f3-1e0b-4349-b708-1dcc34110b24 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:57.856879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7cbd02f3-1e0b-4349-b708-1dcc34110b24 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:57.858602 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7cbd02f3-1e0b-4349-b708-1dcc34110b24 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:57.859847 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7cbd02f3-1e0b-4349-b708-1dcc34110b24 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1723 microversion: 2.20 time: 0.207375 Aug 24 17:54:57.860401 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 420/841] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:57 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:58.887781 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0cb2911c-9519-4073-bda4-0c108124ba4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:58.890078 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0cb2911c-9519-4073-bda4-0c108124ba4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:58.900003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0cb2911c-9519-4073-bda4-0c108124ba4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:58.900755 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0cb2911c-9519-4073-bda4-0c108124ba4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:58.901546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0cb2911c-9519-4073-bda4-0c108124ba4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:58.902576 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0cb2911c-9519-4073-bda4-0c108124ba4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:58.903853 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0cb2911c-9519-4073-bda4-0c108124ba4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:58.904480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0cb2911c-9519-4073-bda4-0c108124ba4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:59.137218 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0cb2911c-9519-4073-bda4-0c108124ba4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:59.147917 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0cb2911c-9519-4073-bda4-0c108124ba4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:59.148498 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0cb2911c-9519-4073-bda4-0c108124ba4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:59.149803 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0cb2911c-9519-4073-bda4-0c108124ba4e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1723 microversion: 2.20 time: 0.268894 Aug 24 17:54:59.151203 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 422/842] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:58 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:59.900124 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-22a36815-0027-4811-9f6b-97c28bd43dab tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-941931582", "imageRef": "2d76d745-abc6-4a7b-b8d7-46566b66934b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60b1f9c5-31f3-434f-b4cc-45bc1ad7c5b8"}], "security_groups": [{"name": "tempest-securitygroup--2020514898"}], "key_name": "tempest-keypair-1813526352", "user_data": "}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:00.023461 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.network.neutron [None req-22a36815-0027-4811-9f6b-97c28bd43dab tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] validate_networks() for [('60b1f9c5-31f3-434f-b4cc-45bc1ad7c5b8', None, None, None, None, None)] {{(pid=127676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:55:00.174256 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3f9f4089-437b-460a-898e-0fec7b6b018b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:00.174884 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3f9f4089-437b-460a-898e-0fec7b6b018b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:00.181742 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3f9f4089-437b-460a-898e-0fec7b6b018b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:00.182268 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3f9f4089-437b-460a-898e-0fec7b6b018b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:00.182709 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3f9f4089-437b-460a-898e-0fec7b6b018b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:00.183442 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3f9f4089-437b-460a-898e-0fec7b6b018b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:00.183923 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3f9f4089-437b-460a-898e-0fec7b6b018b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:00.184350 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3f9f4089-437b-460a-898e-0fec7b6b018b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:00.370698 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3f9f4089-437b-460a-898e-0fec7b6b018b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:00.386132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3f9f4089-437b-460a-898e-0fec7b6b018b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:00.389588 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3f9f4089-437b-460a-898e-0fec7b6b018b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:00.391739 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3f9f4089-437b-460a-898e-0fec7b6b018b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1723 microversion: 2.20 time: 0.221152 Aug 24 17:55:00.392855 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 423/843] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:00 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:00.645599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-22a36815-0027-4811-9f6b-97c28bd43dab tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Flavor limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:55:00.646136 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-22a36815-0027-4811-9f6b-97c28bd43dab tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Image limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:55:00.646832 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-22a36815-0027-4811-9f6b-97c28bd43dab tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Flavor pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:55:00.647292 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-22a36815-0027-4811-9f6b-97c28bd43dab tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Image pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:55:00.647783 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-22a36815-0027-4811-9f6b-97c28bd43dab tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:55:00.658932 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-22a36815-0027-4811-9f6b-97c28bd43dab tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:00.659421 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-22a36815-0027-4811-9f6b-97c28bd43dab tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:00.659887 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-22a36815-0027-4811-9f6b-97c28bd43dab tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:00.660633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-22a36815-0027-4811-9f6b-97c28bd43dab tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:00.661097 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-22a36815-0027-4811-9f6b-97c28bd43dab tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:00.661640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-22a36815-0027-4811-9f6b-97c28bd43dab tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:00.681612 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-22a36815-0027-4811-9f6b-97c28bd43dab tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Getting quotas for project 0a4d7fadea104c569ca29ff9be48089a. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:55:00.687706 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-22a36815-0027-4811-9f6b-97c28bd43dab tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Getting quotas for user 251bc85f89774142a97acd77895b14e9 and project 0a4d7fadea104c569ca29ff9be48089a. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:55:00.701483 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-22a36815-0027-4811-9f6b-97c28bd43dab tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Going to run 1 instances... {{(pid=127676) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:55:00.703934 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-22a36815-0027-4811-9f6b-97c28bd43dab tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d76d745-abc6-4a7b-b8d7-46566b66934b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:55:00.831832 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-22a36815-0027-4811-9f6b-97c28bd43dab tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.936490 Aug 24 17:55:00.832962 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 421/844] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 17:54:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:55:00.845353 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-bc2412a3-d971-41de-8d77-def9c5f08968 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:00.846020 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-bc2412a3-d971-41de-8d77-def9c5f08968 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:00.905778 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-bc2412a3-d971-41de-8d77-def9c5f08968 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:00.916011 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-bc2412a3-d971-41de-8d77-def9c5f08968 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 200 len: 1241 microversion: 2.1 time: 0.075530 Aug 24 17:55:00.922444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 424/845] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:00 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:01.417356 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b5f7ac9f-4d08-472d-bf7a-116ec870b847 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:01.417967 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-b5f7ac9f-4d08-472d-bf7a-116ec870b847 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:01.427614 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b5f7ac9f-4d08-472d-bf7a-116ec870b847 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:01.428209 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b5f7ac9f-4d08-472d-bf7a-116ec870b847 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:01.428701 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b5f7ac9f-4d08-472d-bf7a-116ec870b847 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:01.429471 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b5f7ac9f-4d08-472d-bf7a-116ec870b847 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:01.430142 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b5f7ac9f-4d08-472d-bf7a-116ec870b847 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:01.430719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b5f7ac9f-4d08-472d-bf7a-116ec870b847 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:01.624726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b5f7ac9f-4d08-472d-bf7a-116ec870b847 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:01.634248 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b5f7ac9f-4d08-472d-bf7a-116ec870b847 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:01.635836 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b5f7ac9f-4d08-472d-bf7a-116ec870b847 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:01.638873 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b5f7ac9f-4d08-472d-bf7a-116ec870b847 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1723 microversion: 2.20 time: 0.225978 Aug 24 17:55:01.639470 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 422/846] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:01 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:01.940206 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9061acc4-8a9b-4809-8584-9ef336e685af tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:01.941081 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9061acc4-8a9b-4809-8584-9ef336e685af tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:01.950313 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9061acc4-8a9b-4809-8584-9ef336e685af tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:01.951177 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9061acc4-8a9b-4809-8584-9ef336e685af tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:01.951671 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9061acc4-8a9b-4809-8584-9ef336e685af tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:01.952601 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9061acc4-8a9b-4809-8584-9ef336e685af tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:01.953111 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9061acc4-8a9b-4809-8584-9ef336e685af tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:01.953651 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9061acc4-8a9b-4809-8584-9ef336e685af tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:02.023915 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9061acc4-8a9b-4809-8584-9ef336e685af tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:02.033737 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9061acc4-8a9b-4809-8584-9ef336e685af tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 200 len: 1245 microversion: 2.1 time: 0.098357 Aug 24 17:55:02.034371 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 425/847] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:01 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 1245 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:02.664250 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-3a23206b-daba-4833-bf25-bbd4b2d8b5d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:02.664866 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-3a23206b-daba-4833-bf25-bbd4b2d8b5d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:02.671998 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3a23206b-daba-4833-bf25-bbd4b2d8b5d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:02.672492 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3a23206b-daba-4833-bf25-bbd4b2d8b5d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:02.672939 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3a23206b-daba-4833-bf25-bbd4b2d8b5d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:02.673710 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3a23206b-daba-4833-bf25-bbd4b2d8b5d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:02.674207 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3a23206b-daba-4833-bf25-bbd4b2d8b5d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:02.674643 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3a23206b-daba-4833-bf25-bbd4b2d8b5d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:02.818779 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-3a23206b-daba-4833-bf25-bbd4b2d8b5d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:02.830597 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-3a23206b-daba-4833-bf25-bbd4b2d8b5d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:02.832637 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-3a23206b-daba-4833-bf25-bbd4b2d8b5d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:02.833926 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-3a23206b-daba-4833-bf25-bbd4b2d8b5d9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1723 microversion: 2.20 time: 0.174170 Aug 24 17:55:02.834489 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 423/848] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:02 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:03.056856 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-dbf697aa-ed9b-4e9a-ae30-737fd7c93c24 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:03.057391 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-dbf697aa-ed9b-4e9a-ae30-737fd7c93c24 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:03.065042 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dbf697aa-ed9b-4e9a-ae30-737fd7c93c24 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:03.065565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dbf697aa-ed9b-4e9a-ae30-737fd7c93c24 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:03.066008 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dbf697aa-ed9b-4e9a-ae30-737fd7c93c24 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:03.066716 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dbf697aa-ed9b-4e9a-ae30-737fd7c93c24 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:03.067172 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dbf697aa-ed9b-4e9a-ae30-737fd7c93c24 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:03.067596 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-dbf697aa-ed9b-4e9a-ae30-737fd7c93c24 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:03.144131 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-dbf697aa-ed9b-4e9a-ae30-737fd7c93c24 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:03.152599 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-dbf697aa-ed9b-4e9a-ae30-737fd7c93c24 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 200 len: 1301 microversion: 2.1 time: 0.099910 Aug 24 17:55:03.152871 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 426/849] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:03 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 1301 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:03.862657 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-c98e3f69-f7bc-4474-a222-79cf45ec7c64 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:03.863654 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-c98e3f69-f7bc-4474-a222-79cf45ec7c64 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:03.874912 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c98e3f69-f7bc-4474-a222-79cf45ec7c64 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:03.875493 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c98e3f69-f7bc-4474-a222-79cf45ec7c64 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:03.876373 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c98e3f69-f7bc-4474-a222-79cf45ec7c64 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:03.877626 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c98e3f69-f7bc-4474-a222-79cf45ec7c64 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:03.878495 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c98e3f69-f7bc-4474-a222-79cf45ec7c64 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:03.879269 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c98e3f69-f7bc-4474-a222-79cf45ec7c64 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:04.065976 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c98e3f69-f7bc-4474-a222-79cf45ec7c64 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:04.075245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c98e3f69-f7bc-4474-a222-79cf45ec7c64 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:04.076966 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c98e3f69-f7bc-4474-a222-79cf45ec7c64 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:04.078571 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-c98e3f69-f7bc-4474-a222-79cf45ec7c64 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1744 microversion: 2.20 time: 0.223269 Aug 24 17:55:04.089810 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 424/850] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:03 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1744 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:55:04.174479 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-610ba6bb-baf7-41d2-b730-32b42d3025e0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:04.175126 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-610ba6bb-baf7-41d2-b730-32b42d3025e0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:04.182719 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-610ba6bb-baf7-41d2-b730-32b42d3025e0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:04.189758 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-610ba6bb-baf7-41d2-b730-32b42d3025e0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:04.189758 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-610ba6bb-baf7-41d2-b730-32b42d3025e0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:04.189758 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-610ba6bb-baf7-41d2-b730-32b42d3025e0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:04.189758 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-610ba6bb-baf7-41d2-b730-32b42d3025e0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:04.190196 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-610ba6bb-baf7-41d2-b730-32b42d3025e0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:04.337217 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-610ba6bb-baf7-41d2-b730-32b42d3025e0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:04.341667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:04.346663 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-610ba6bb-baf7-41d2-b730-32b42d3025e0 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 200 len: 1367 microversion: 2.1 time: 0.176473 Aug 24 17:55:04.347251 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 427/851] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:04 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:05.061367 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-18482b60-22d3-4fe5-86f2-22a9d3a519c0 req-fc0f7775-5cec-40d0-b69c-0e8ab9d1379f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a759f40-8f53-4041-85f4-6f56cdded52b", "tag": "fd7822b1-ee55-4ee8-b60e-46b6ff456ee9"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:05.072440 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-18482b60-22d3-4fe5-86f2-22a9d3a519c0 req-fc0f7775-5cec-40d0-b69c-0e8ab9d1379f service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:05.072934 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-18482b60-22d3-4fe5-86f2-22a9d3a519c0 req-fc0f7775-5cec-40d0-b69c-0e8ab9d1379f service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:05.073363 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-18482b60-22d3-4fe5-86f2-22a9d3a519c0 req-fc0f7775-5cec-40d0-b69c-0e8ab9d1379f service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:05.086260 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-18482b60-22d3-4fe5-86f2-22a9d3a519c0 req-fc0f7775-5cec-40d0-b69c-0e8ab9d1379f service nova] Creating event network-changed:fd7822b1-ee55-4ee8-b60e-46b6ff456ee9 for instance 5a759f40-8f53-4041-85f4-6f56cdded52b on hv-cinder-85442 Aug 24 17:55:05.092828 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-18482b60-22d3-4fe5-86f2-22a9d3a519c0 req-fc0f7775-5cec-40d0-b69c-0e8ab9d1379f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035132 Aug 24 17:55:05.093449 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 425/852] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:05.108053 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-5cf95a8c-0765-4ce0-b8b1-4e106beb2bae tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:05.108699 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-5cf95a8c-0765-4ce0-b8b1-4e106beb2bae tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:05.115963 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5cf95a8c-0765-4ce0-b8b1-4e106beb2bae tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:05.117707 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5cf95a8c-0765-4ce0-b8b1-4e106beb2bae tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:05.118386 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5cf95a8c-0765-4ce0-b8b1-4e106beb2bae tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:05.119148 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5cf95a8c-0765-4ce0-b8b1-4e106beb2bae tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:05.119615 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5cf95a8c-0765-4ce0-b8b1-4e106beb2bae tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:05.120071 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5cf95a8c-0765-4ce0-b8b1-4e106beb2bae tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:05.350384 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5cf95a8c-0765-4ce0-b8b1-4e106beb2bae tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:05.360974 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5cf95a8c-0765-4ce0-b8b1-4e106beb2bae tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:05.367624 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5cf95a8c-0765-4ce0-b8b1-4e106beb2bae tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:05.372939 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e21f310a-76e0-4d0e-bed0-f9b0c5f3c386 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:05.374463 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e21f310a-76e0-4d0e-bed0-f9b0c5f3c386 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:05.388831 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-5cf95a8c-0765-4ce0-b8b1-4e106beb2bae tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1744 microversion: 2.20 time: 0.283165 Aug 24 17:55:05.389028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e21f310a-76e0-4d0e-bed0-f9b0c5f3c386 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:05.389153 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 428/853] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:05 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1744 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:05.389254 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e21f310a-76e0-4d0e-bed0-f9b0c5f3c386 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:05.389254 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e21f310a-76e0-4d0e-bed0-f9b0c5f3c386 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:05.389254 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e21f310a-76e0-4d0e-bed0-f9b0c5f3c386 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:05.389601 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e21f310a-76e0-4d0e-bed0-f9b0c5f3c386 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:05.390231 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e21f310a-76e0-4d0e-bed0-f9b0c5f3c386 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:05.568188 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e21f310a-76e0-4d0e-bed0-f9b0c5f3c386 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:05.578570 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:05.591920 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e21f310a-76e0-4d0e-bed0-f9b0c5f3c386 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 200 len: 1367 microversion: 2.1 time: 0.226593 Aug 24 17:55:05.592511 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 426/854] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:05 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:06.408715 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f5b407ea-cbcc-4288-b2dd-59680de19103 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:06.412800 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-f5b407ea-cbcc-4288-b2dd-59680de19103 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:06.416198 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f5b407ea-cbcc-4288-b2dd-59680de19103 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:06.416688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f5b407ea-cbcc-4288-b2dd-59680de19103 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:06.417124 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f5b407ea-cbcc-4288-b2dd-59680de19103 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:06.418231 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f5b407ea-cbcc-4288-b2dd-59680de19103 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:06.418883 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f5b407ea-cbcc-4288-b2dd-59680de19103 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:06.419327 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f5b407ea-cbcc-4288-b2dd-59680de19103 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:06.564102 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f5b407ea-cbcc-4288-b2dd-59680de19103 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:06.572641 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f5b407ea-cbcc-4288-b2dd-59680de19103 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:06.574711 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f5b407ea-cbcc-4288-b2dd-59680de19103 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:06.576031 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-f5b407ea-cbcc-4288-b2dd-59680de19103 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1739 microversion: 2.20 time: 0.171749 Aug 24 17:55:06.576593 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 429/855] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:06 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:06.613058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0b800d2d-9461-4f59-a558-d3e607b51d36 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:06.613585 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0b800d2d-9461-4f59-a558-d3e607b51d36 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:06.620340 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0b800d2d-9461-4f59-a558-d3e607b51d36 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:06.621677 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0b800d2d-9461-4f59-a558-d3e607b51d36 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:06.621936 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0b800d2d-9461-4f59-a558-d3e607b51d36 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:06.622787 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0b800d2d-9461-4f59-a558-d3e607b51d36 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:06.623339 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0b800d2d-9461-4f59-a558-d3e607b51d36 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:06.623882 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0b800d2d-9461-4f59-a558-d3e607b51d36 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:06.769931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0b800d2d-9461-4f59-a558-d3e607b51d36 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:06.779226 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0b800d2d-9461-4f59-a558-d3e607b51d36 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 200 len: 1367 microversion: 2.1 time: 0.170074 Aug 24 17:55:06.789592 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 427/856] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:06 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:07.517405 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-a475a403-0a57-45fd-a38d-411600fedb8a req-5bedf950-465a-4709-8663-c6b574704fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861f638b-1bdf-459e-bf10-2846d8994ac4", "name": "network-vif-plugged", "status": "completed", "tag": "83c659e2-8827-4402-9131-6edb2b9b0a44"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:07.528249 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-a475a403-0a57-45fd-a38d-411600fedb8a req-5bedf950-465a-4709-8663-c6b574704fb8 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:07.528849 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-a475a403-0a57-45fd-a38d-411600fedb8a req-5bedf950-465a-4709-8663-c6b574704fb8 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:07.529297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-a475a403-0a57-45fd-a38d-411600fedb8a req-5bedf950-465a-4709-8663-c6b574704fb8 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:07.563546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-a475a403-0a57-45fd-a38d-411600fedb8a req-5bedf950-465a-4709-8663-c6b574704fb8 service nova] Creating event network-vif-plugged:83c659e2-8827-4402-9131-6edb2b9b0a44 for instance 861f638b-1bdf-459e-bf10-2846d8994ac4 on hv-cinder-85442 Aug 24 17:55:07.573901 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-a475a403-0a57-45fd-a38d-411600fedb8a req-5bedf950-465a-4709-8663-c6b574704fb8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128059 Aug 24 17:55:07.576392 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 430/857] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:07.600094 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-449f494b-8958-4df0-be1b-e479efa4881c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:07.600938 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-449f494b-8958-4df0-be1b-e479efa4881c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:07.603076 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:07.609412 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-449f494b-8958-4df0-be1b-e479efa4881c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:07.609949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-449f494b-8958-4df0-be1b-e479efa4881c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:07.610580 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-449f494b-8958-4df0-be1b-e479efa4881c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:07.611469 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-449f494b-8958-4df0-be1b-e479efa4881c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:07.612085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-449f494b-8958-4df0-be1b-e479efa4881c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:07.612671 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-449f494b-8958-4df0-be1b-e479efa4881c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:07.776636 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-449f494b-8958-4df0-be1b-e479efa4881c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:07.787018 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-449f494b-8958-4df0-be1b-e479efa4881c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:07.789660 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-449f494b-8958-4df0-be1b-e479efa4881c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:07.791083 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-449f494b-8958-4df0-be1b-e479efa4881c tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1739 microversion: 2.20 time: 0.194956 Aug 24 17:55:07.813204 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c168ce0d-2085-45bc-b5f2-3c5cd9ffa936 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:07.813961 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c168ce0d-2085-45bc-b5f2-3c5cd9ffa936 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:07.817688 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 428/858] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:07 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:07.821451 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c168ce0d-2085-45bc-b5f2-3c5cd9ffa936 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:07.821941 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c168ce0d-2085-45bc-b5f2-3c5cd9ffa936 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:07.822586 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c168ce0d-2085-45bc-b5f2-3c5cd9ffa936 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:07.823607 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c168ce0d-2085-45bc-b5f2-3c5cd9ffa936 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:07.824088 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c168ce0d-2085-45bc-b5f2-3c5cd9ffa936 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:07.824668 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c168ce0d-2085-45bc-b5f2-3c5cd9ffa936 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:07.999322 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c168ce0d-2085-45bc-b5f2-3c5cd9ffa936 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:08.008537 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c168ce0d-2085-45bc-b5f2-3c5cd9ffa936 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 200 len: 1367 microversion: 2.1 time: 0.200407 Aug 24 17:55:08.009358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 431/859] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:07 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:08.818118 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-63b90ec9-d56f-41ba-b01b-008f5e7c8b82 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:08.819750 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-63b90ec9-d56f-41ba-b01b-008f5e7c8b82 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:08.828475 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-63b90ec9-d56f-41ba-b01b-008f5e7c8b82 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:08.828962 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-63b90ec9-d56f-41ba-b01b-008f5e7c8b82 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:08.829398 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-63b90ec9-d56f-41ba-b01b-008f5e7c8b82 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:08.830144 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-63b90ec9-d56f-41ba-b01b-008f5e7c8b82 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:08.830596 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-63b90ec9-d56f-41ba-b01b-008f5e7c8b82 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:08.831020 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-63b90ec9-d56f-41ba-b01b-008f5e7c8b82 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:09.006357 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-63b90ec9-d56f-41ba-b01b-008f5e7c8b82 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:09.019744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-63b90ec9-d56f-41ba-b01b-008f5e7c8b82 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:09.023222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-63b90ec9-d56f-41ba-b01b-008f5e7c8b82 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:09.033290 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d6f419d2-b337-477e-bb15-c0f0f7907e75 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:09.034623 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d6f419d2-b337-477e-bb15-c0f0f7907e75 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:09.036023 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-63b90ec9-d56f-41ba-b01b-008f5e7c8b82 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1739 microversion: 2.20 time: 0.221840 Aug 24 17:55:09.046020 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 429/860] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:08 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:09.059991 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d6f419d2-b337-477e-bb15-c0f0f7907e75 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:09.060880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d6f419d2-b337-477e-bb15-c0f0f7907e75 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:09.062097 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d6f419d2-b337-477e-bb15-c0f0f7907e75 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:09.063470 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d6f419d2-b337-477e-bb15-c0f0f7907e75 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:09.064354 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d6f419d2-b337-477e-bb15-c0f0f7907e75 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:09.065465 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d6f419d2-b337-477e-bb15-c0f0f7907e75 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:09.226282 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d6f419d2-b337-477e-bb15-c0f0f7907e75 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:09.235471 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d6f419d2-b337-477e-bb15-c0f0f7907e75 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 200 len: 1367 microversion: 2.1 time: 0.208457 Aug 24 17:55:09.236046 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 432/861] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:09 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:10.063047 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-19216384-9f94-45fd-b174-a986381f7e34 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:10.063753 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-19216384-9f94-45fd-b174-a986381f7e34 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:10.070569 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-19216384-9f94-45fd-b174-a986381f7e34 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:10.071066 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-19216384-9f94-45fd-b174-a986381f7e34 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:10.071532 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-19216384-9f94-45fd-b174-a986381f7e34 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:10.072384 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-19216384-9f94-45fd-b174-a986381f7e34 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:10.072849 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-19216384-9f94-45fd-b174-a986381f7e34 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:10.073431 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-19216384-9f94-45fd-b174-a986381f7e34 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:10.214616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-19216384-9f94-45fd-b174-a986381f7e34 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:10.223761 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-19216384-9f94-45fd-b174-a986381f7e34 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:10.225372 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-19216384-9f94-45fd-b174-a986381f7e34 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:10.226641 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-19216384-9f94-45fd-b174-a986381f7e34 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1739 microversion: 2.20 time: 0.168732 Aug 24 17:55:10.227203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 430/862] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:10 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:10.261256 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-be8fd39e-a668-4f3d-be6b-3e85b790fb2a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:10.262917 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-be8fd39e-a668-4f3d-be6b-3e85b790fb2a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:10.271142 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-be8fd39e-a668-4f3d-be6b-3e85b790fb2a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:10.271632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-be8fd39e-a668-4f3d-be6b-3e85b790fb2a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:10.272067 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-be8fd39e-a668-4f3d-be6b-3e85b790fb2a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:10.272768 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-be8fd39e-a668-4f3d-be6b-3e85b790fb2a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:10.273256 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-be8fd39e-a668-4f3d-be6b-3e85b790fb2a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:10.273679 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-be8fd39e-a668-4f3d-be6b-3e85b790fb2a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:10.469403 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-be8fd39e-a668-4f3d-be6b-3e85b790fb2a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:10.482512 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-be8fd39e-a668-4f3d-be6b-3e85b790fb2a tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 200 len: 1367 microversion: 2.1 time: 0.228497 Aug 24 17:55:10.484535 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 433/863] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:10 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:11.249729 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8d4f8d3e-08fd-45b7-ad27-dbf714678474 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:11.251026 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8d4f8d3e-08fd-45b7-ad27-dbf714678474 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:11.252930 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=2 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:11.253606 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=6 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:11.259782 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8d4f8d3e-08fd-45b7-ad27-dbf714678474 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:11.260749 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8d4f8d3e-08fd-45b7-ad27-dbf714678474 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:11.263710 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8d4f8d3e-08fd-45b7-ad27-dbf714678474 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:11.263710 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8d4f8d3e-08fd-45b7-ad27-dbf714678474 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:11.263710 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8d4f8d3e-08fd-45b7-ad27-dbf714678474 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:11.264166 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8d4f8d3e-08fd-45b7-ad27-dbf714678474 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:11.460595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8d4f8d3e-08fd-45b7-ad27-dbf714678474 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:11.475434 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8d4f8d3e-08fd-45b7-ad27-dbf714678474 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:11.478821 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8d4f8d3e-08fd-45b7-ad27-dbf714678474 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:11.481463 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-8d4f8d3e-08fd-45b7-ad27-dbf714678474 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1739 microversion: 2.20 time: 0.235672 Aug 24 17:55:11.483067 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 431/864] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:11 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:11.504471 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=6 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:11.508591 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c97ba602-b161-4170-b7ba-50dd8a09a8a1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:11.509333 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c97ba602-b161-4170-b7ba-50dd8a09a8a1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:11.516932 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c97ba602-b161-4170-b7ba-50dd8a09a8a1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:11.517778 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c97ba602-b161-4170-b7ba-50dd8a09a8a1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:11.518500 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c97ba602-b161-4170-b7ba-50dd8a09a8a1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:11.519715 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c97ba602-b161-4170-b7ba-50dd8a09a8a1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:11.520422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c97ba602-b161-4170-b7ba-50dd8a09a8a1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:11.521095 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c97ba602-b161-4170-b7ba-50dd8a09a8a1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:11.712648 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c97ba602-b161-4170-b7ba-50dd8a09a8a1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:11.722727 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c97ba602-b161-4170-b7ba-50dd8a09a8a1 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 200 len: 1367 microversion: 2.1 time: 0.222876 Aug 24 17:55:11.750038 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 434/865] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:11 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:11.828323 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-d739f2bb-de1d-4ebb-9ca3-63526efd35b1 req-4cdd6100-9b22-40c7-83e2-a02461cfa92b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a759f40-8f53-4041-85f4-6f56cdded52b", "name": "network-vif-plugged", "status": "completed", "tag": "fd7822b1-ee55-4ee8-b60e-46b6ff456ee9"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:11.839061 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-d739f2bb-de1d-4ebb-9ca3-63526efd35b1 req-4cdd6100-9b22-40c7-83e2-a02461cfa92b service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:11.840524 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-d739f2bb-de1d-4ebb-9ca3-63526efd35b1 req-4cdd6100-9b22-40c7-83e2-a02461cfa92b service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:11.841320 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-d739f2bb-de1d-4ebb-9ca3-63526efd35b1 req-4cdd6100-9b22-40c7-83e2-a02461cfa92b service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:11.860917 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-d739f2bb-de1d-4ebb-9ca3-63526efd35b1 req-4cdd6100-9b22-40c7-83e2-a02461cfa92b service nova] Creating event network-vif-plugged:fd7822b1-ee55-4ee8-b60e-46b6ff456ee9 for instance 5a759f40-8f53-4041-85f4-6f56cdded52b on hv-cinder-85442 Aug 24 17:55:11.869074 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-d739f2bb-de1d-4ebb-9ca3-63526efd35b1 req-4cdd6100-9b22-40c7-83e2-a02461cfa92b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045299 Aug 24 17:55:11.869879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 432/866] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:12.514144 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-10def9d0-61df-4db6-921a-9b0348baf2b4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:12.516316 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-10def9d0-61df-4db6-921a-9b0348baf2b4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:12.527989 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-10def9d0-61df-4db6-921a-9b0348baf2b4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:12.528515 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-10def9d0-61df-4db6-921a-9b0348baf2b4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:12.528966 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-10def9d0-61df-4db6-921a-9b0348baf2b4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:12.529761 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-10def9d0-61df-4db6-921a-9b0348baf2b4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:12.530456 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-10def9d0-61df-4db6-921a-9b0348baf2b4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:12.531052 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-10def9d0-61df-4db6-921a-9b0348baf2b4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:12.725576 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-10def9d0-61df-4db6-921a-9b0348baf2b4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:12.736803 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-10def9d0-61df-4db6-921a-9b0348baf2b4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:12.738459 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-10def9d0-61df-4db6-921a-9b0348baf2b4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:12.739831 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-10def9d0-61df-4db6-921a-9b0348baf2b4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1739 microversion: 2.20 time: 0.234673 Aug 24 17:55:12.740421 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 435/867] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:12 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:12.753418 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ae5bcdb1-de59-4d2f-afd5-7ec0ab78e43d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:12.754769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-ae5bcdb1-de59-4d2f-afd5-7ec0ab78e43d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:12.762638 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ae5bcdb1-de59-4d2f-afd5-7ec0ab78e43d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:12.763143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ae5bcdb1-de59-4d2f-afd5-7ec0ab78e43d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:12.763587 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ae5bcdb1-de59-4d2f-afd5-7ec0ab78e43d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:12.764816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ae5bcdb1-de59-4d2f-afd5-7ec0ab78e43d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:12.764816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ae5bcdb1-de59-4d2f-afd5-7ec0ab78e43d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:12.767406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ae5bcdb1-de59-4d2f-afd5-7ec0ab78e43d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:12.914811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-ae5bcdb1-de59-4d2f-afd5-7ec0ab78e43d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:12.929195 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-ae5bcdb1-de59-4d2f-afd5-7ec0ab78e43d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 200 len: 1367 microversion: 2.1 time: 0.180774 Aug 24 17:55:12.930107 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 433/868] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:12 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:13.189193 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-88adbe35-275a-4d94-9f2b-d35d8ba2f5b9 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:13.189193 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-88adbe35-275a-4d94-9f2b-d35d8ba2f5b9 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:13.191949 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-88adbe35-275a-4d94-9f2b-d35d8ba2f5b9 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:13.192435 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-88adbe35-275a-4d94-9f2b-d35d8ba2f5b9 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:13.192871 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-88adbe35-275a-4d94-9f2b-d35d8ba2f5b9 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:13.193548 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-88adbe35-275a-4d94-9f2b-d35d8ba2f5b9 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:13.194053 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-88adbe35-275a-4d94-9f2b-d35d8ba2f5b9 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:13.194542 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-88adbe35-275a-4d94-9f2b-d35d8ba2f5b9 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:13.287704 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-88adbe35-275a-4d94-9f2b-d35d8ba2f5b9 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lazy-loading 'services' on Instance uuid d27bf857-8c45-4e91-b69c-a5ff394f502b {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:55:13.561259 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-88adbe35-275a-4d94-9f2b-d35d8ba2f5b9 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/os-volume_attachments/ee355dd0-4818-44f6-a8a2-c31f104d6bf0" status: 202 len: 0 microversion: 2.1 time: 0.380605 Aug 24 17:55:13.562305 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 436/869] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 17:55:13 2022] DELETE /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/os-volume_attachments/ee355dd0-4818-44f6-a8a2-c31f104d6bf0 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:55:13.572274 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a858419e-f2a2-4f55-b810-83ba5a750b5b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:13.575665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a858419e-f2a2-4f55-b810-83ba5a750b5b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:13.582218 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a858419e-f2a2-4f55-b810-83ba5a750b5b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:13.582679 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a858419e-f2a2-4f55-b810-83ba5a750b5b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:13.583127 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a858419e-f2a2-4f55-b810-83ba5a750b5b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:13.583838 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a858419e-f2a2-4f55-b810-83ba5a750b5b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:13.584296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a858419e-f2a2-4f55-b810-83ba5a750b5b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:13.584727 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a858419e-f2a2-4f55-b810-83ba5a750b5b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:13.617594 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a858419e-f2a2-4f55-b810-83ba5a750b5b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050817 Aug 24 17:55:13.618514 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 434/870] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:55:13 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:13.766285 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c5bb73c5-1cc2-413e-ba90-4cd2b058158d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:13.767516 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c5bb73c5-1cc2-413e-ba90-4cd2b058158d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:13.774805 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c5bb73c5-1cc2-413e-ba90-4cd2b058158d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:13.775624 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c5bb73c5-1cc2-413e-ba90-4cd2b058158d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:13.776158 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c5bb73c5-1cc2-413e-ba90-4cd2b058158d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:13.777382 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c5bb73c5-1cc2-413e-ba90-4cd2b058158d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:13.778019 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c5bb73c5-1cc2-413e-ba90-4cd2b058158d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:13.778530 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c5bb73c5-1cc2-413e-ba90-4cd2b058158d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:13.941208 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c5bb73c5-1cc2-413e-ba90-4cd2b058158d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:13.950922 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c5bb73c5-1cc2-413e-ba90-4cd2b058158d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:13.953117 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8e524b54-d1f5-4dd1-98b9-1f132532cc42 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:13.954610 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8e524b54-d1f5-4dd1-98b9-1f132532cc42 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:13.957716 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c5bb73c5-1cc2-413e-ba90-4cd2b058158d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:13.959000 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c5bb73c5-1cc2-413e-ba90-4cd2b058158d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1739 microversion: 2.20 time: 0.197842 Aug 24 17:55:13.959927 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 437/871] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:13 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:55:13.966275 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8e524b54-d1f5-4dd1-98b9-1f132532cc42 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:13.967297 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8e524b54-d1f5-4dd1-98b9-1f132532cc42 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:13.967909 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8e524b54-d1f5-4dd1-98b9-1f132532cc42 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:13.968823 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8e524b54-d1f5-4dd1-98b9-1f132532cc42 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:13.969452 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8e524b54-d1f5-4dd1-98b9-1f132532cc42 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:13.970080 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8e524b54-d1f5-4dd1-98b9-1f132532cc42 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:14.131881 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8e524b54-d1f5-4dd1-98b9-1f132532cc42 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:14.141796 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-8e524b54-d1f5-4dd1-98b9-1f132532cc42 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 200 len: 1367 microversion: 2.1 time: 0.192839 Aug 24 17:55:14.155290 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 435/872] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:13 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:14.632858 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d66eabf1-8ddb-4f8a-819f-36b4d30b3c88 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:14.635348 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d66eabf1-8ddb-4f8a-819f-36b4d30b3c88 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:14.642710 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d66eabf1-8ddb-4f8a-819f-36b4d30b3c88 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:14.643194 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d66eabf1-8ddb-4f8a-819f-36b4d30b3c88 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:14.643627 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d66eabf1-8ddb-4f8a-819f-36b4d30b3c88 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:14.644920 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d66eabf1-8ddb-4f8a-819f-36b4d30b3c88 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:14.645398 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d66eabf1-8ddb-4f8a-819f-36b4d30b3c88 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:14.645797 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d66eabf1-8ddb-4f8a-819f-36b4d30b3c88 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:14.687800 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d66eabf1-8ddb-4f8a-819f-36b4d30b3c88 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058912 Aug 24 17:55:14.688398 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 438/873] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:55:14 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:14.985617 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-60d3dad1-ec0a-4bb7-ac79-840b0b4b6a29 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:14.987072 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-60d3dad1-ec0a-4bb7-ac79-840b0b4b6a29 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:14.998248 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-60d3dad1-ec0a-4bb7-ac79-840b0b4b6a29 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:14.999482 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-60d3dad1-ec0a-4bb7-ac79-840b0b4b6a29 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:15.000069 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-60d3dad1-ec0a-4bb7-ac79-840b0b4b6a29 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:15.001279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-60d3dad1-ec0a-4bb7-ac79-840b0b4b6a29 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:15.001991 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-60d3dad1-ec0a-4bb7-ac79-840b0b4b6a29 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:15.002690 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-60d3dad1-ec0a-4bb7-ac79-840b0b4b6a29 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:15.160009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-60d3dad1-ec0a-4bb7-ac79-840b0b4b6a29 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:15.162951 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3c7e81f5-09d0-4fdf-8f72-f034dd958b7d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:15.163846 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3c7e81f5-09d0-4fdf-8f72-f034dd958b7d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:15.170714 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c7e81f5-09d0-4fdf-8f72-f034dd958b7d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:15.171263 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c7e81f5-09d0-4fdf-8f72-f034dd958b7d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:15.171778 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c7e81f5-09d0-4fdf-8f72-f034dd958b7d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:15.172737 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c7e81f5-09d0-4fdf-8f72-f034dd958b7d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:15.173262 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-60d3dad1-ec0a-4bb7-ac79-840b0b4b6a29 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:15.173971 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c7e81f5-09d0-4fdf-8f72-f034dd958b7d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:15.174528 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c7e81f5-09d0-4fdf-8f72-f034dd958b7d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:15.175751 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-60d3dad1-ec0a-4bb7-ac79-840b0b4b6a29 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:15.177346 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-60d3dad1-ec0a-4bb7-ac79-840b0b4b6a29 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1739 microversion: 2.20 time: 0.198136 Aug 24 17:55:15.178668 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 436/874] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:14 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:55:15.353055 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3c7e81f5-09d0-4fdf-8f72-f034dd958b7d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:15.365474 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3c7e81f5-09d0-4fdf-8f72-f034dd958b7d tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 200 len: 1557 microversion: 2.1 time: 0.206707 Aug 24 17:55:15.369892 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 439/875] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:15 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 1557 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:15.390173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7932a371-f4e5-4378-b731-0e665b9e16ca tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:15.391188 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7932a371-f4e5-4378-b731-0e665b9e16ca tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:15.397761 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7932a371-f4e5-4378-b731-0e665b9e16ca tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:15.400806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7932a371-f4e5-4378-b731-0e665b9e16ca tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:15.401402 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7932a371-f4e5-4378-b731-0e665b9e16ca tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:15.402364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7932a371-f4e5-4378-b731-0e665b9e16ca tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:15.402909 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7932a371-f4e5-4378-b731-0e665b9e16ca tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:15.403435 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7932a371-f4e5-4378-b731-0e665b9e16ca tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:15.514314 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7932a371-f4e5-4378-b731-0e665b9e16ca tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128106 Aug 24 17:55:15.516643 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 437/876] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 24 17:55:15 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:15.705129 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4efa4de9-fde8-42fa-8f9f-3e7eccd53d7c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:15.708645 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4efa4de9-fde8-42fa-8f9f-3e7eccd53d7c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:15.719368 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4efa4de9-fde8-42fa-8f9f-3e7eccd53d7c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:15.720148 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4efa4de9-fde8-42fa-8f9f-3e7eccd53d7c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:15.720659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4efa4de9-fde8-42fa-8f9f-3e7eccd53d7c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:15.722058 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4efa4de9-fde8-42fa-8f9f-3e7eccd53d7c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:15.722548 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4efa4de9-fde8-42fa-8f9f-3e7eccd53d7c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:15.723007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4efa4de9-fde8-42fa-8f9f-3e7eccd53d7c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:15.760115 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-4efa4de9-fde8-42fa-8f9f-3e7eccd53d7c tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062021 Aug 24 17:55:15.767691 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 440/877] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:55:15 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:55:15.851394 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-4752bc47-dbcb-4ae4-a9e2-8ece067eca67 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:15.852337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4752bc47-dbcb-4ae4-a9e2-8ece067eca67 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:15.860871 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4752bc47-dbcb-4ae4-a9e2-8ece067eca67 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:15.861601 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4752bc47-dbcb-4ae4-a9e2-8ece067eca67 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:15.862317 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4752bc47-dbcb-4ae4-a9e2-8ece067eca67 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:15.863178 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4752bc47-dbcb-4ae4-a9e2-8ece067eca67 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:15.863837 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4752bc47-dbcb-4ae4-a9e2-8ece067eca67 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:15.864336 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4752bc47-dbcb-4ae4-a9e2-8ece067eca67 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:15.894959 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4752bc47-dbcb-4ae4-a9e2-8ece067eca67 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Going to try to terminate instance {{(pid=127676) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:55:16.204578 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-834bf3a7-e9d6-419a-8191-51bb89f9c633 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:16.205272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-834bf3a7-e9d6-419a-8191-51bb89f9c633 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:16.217350 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-834bf3a7-e9d6-419a-8191-51bb89f9c633 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:16.217897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-834bf3a7-e9d6-419a-8191-51bb89f9c633 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:16.218356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-834bf3a7-e9d6-419a-8191-51bb89f9c633 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:16.219603 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-834bf3a7-e9d6-419a-8191-51bb89f9c633 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:16.219603 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-834bf3a7-e9d6-419a-8191-51bb89f9c633 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:16.220052 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-834bf3a7-e9d6-419a-8191-51bb89f9c633 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:16.273265 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-4752bc47-dbcb-4ae4-a9e2-8ece067eca67 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 204 len: 0 microversion: 2.1 time: 0.425610 Aug 24 17:55:16.274479 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 438/878] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:55:15 2022] DELETE /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:55:16.286820 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-999a587f-2de7-4a46-81a3-9fd5a11f0ec4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:16.291063 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-999a587f-2de7-4a46-81a3-9fd5a11f0ec4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:16.320989 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-999a587f-2de7-4a46-81a3-9fd5a11f0ec4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:16.324235 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-999a587f-2de7-4a46-81a3-9fd5a11f0ec4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:16.325088 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-999a587f-2de7-4a46-81a3-9fd5a11f0ec4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:16.326151 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-999a587f-2de7-4a46-81a3-9fd5a11f0ec4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:16.326698 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-999a587f-2de7-4a46-81a3-9fd5a11f0ec4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:16.327198 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-999a587f-2de7-4a46-81a3-9fd5a11f0ec4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:16.456178 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-834bf3a7-e9d6-419a-8191-51bb89f9c633 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:16.465810 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-834bf3a7-e9d6-419a-8191-51bb89f9c633 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:16.467968 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-834bf3a7-e9d6-419a-8191-51bb89f9c633 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:16.469473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-834bf3a7-e9d6-419a-8191-51bb89f9c633 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1739 microversion: 2.20 time: 0.269361 Aug 24 17:55:16.470419 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 441/879] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:16 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:16.535229 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-999a587f-2de7-4a46-81a3-9fd5a11f0ec4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:16.548586 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-999a587f-2de7-4a46-81a3-9fd5a11f0ec4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1689 microversion: 2.1 time: 0.267623 Aug 24 17:55:16.549609 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 439/880] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:16 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1689 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:17.000961 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-06939790-1b32-4199-a5d6-0cc8a2fc6c8d req-8a79177b-6a69-49cf-8de2-f4c49045b2c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a759f40-8f53-4041-85f4-6f56cdded52b", "tag": "fd7822b1-ee55-4ee8-b60e-46b6ff456ee9"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:17.015155 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-06939790-1b32-4199-a5d6-0cc8a2fc6c8d req-8a79177b-6a69-49cf-8de2-f4c49045b2c4 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:17.015155 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-06939790-1b32-4199-a5d6-0cc8a2fc6c8d req-8a79177b-6a69-49cf-8de2-f4c49045b2c4 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:17.015155 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-06939790-1b32-4199-a5d6-0cc8a2fc6c8d req-8a79177b-6a69-49cf-8de2-f4c49045b2c4 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:17.027997 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-06939790-1b32-4199-a5d6-0cc8a2fc6c8d req-8a79177b-6a69-49cf-8de2-f4c49045b2c4 service nova] Creating event network-changed:fd7822b1-ee55-4ee8-b60e-46b6ff456ee9 for instance 5a759f40-8f53-4041-85f4-6f56cdded52b on hv-cinder-85442 Aug 24 17:55:17.033106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-06939790-1b32-4199-a5d6-0cc8a2fc6c8d req-8a79177b-6a69-49cf-8de2-f4c49045b2c4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035788 Aug 24 17:55:17.033753 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 442/881] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:17.494310 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-2a7f0828-ddc1-4745-86f9-b21254476519 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:17.495002 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-2a7f0828-ddc1-4745-86f9-b21254476519 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:17.513488 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2a7f0828-ddc1-4745-86f9-b21254476519 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:17.516728 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2a7f0828-ddc1-4745-86f9-b21254476519 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:17.516728 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2a7f0828-ddc1-4745-86f9-b21254476519 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:17.516728 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2a7f0828-ddc1-4745-86f9-b21254476519 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:17.516728 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2a7f0828-ddc1-4745-86f9-b21254476519 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:17.517073 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2a7f0828-ddc1-4745-86f9-b21254476519 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:17.571668 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-483c951a-3c76-48fe-a740-567390b5dfe4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:17.577805 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-483c951a-3c76-48fe-a740-567390b5dfe4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:17.586875 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-483c951a-3c76-48fe-a740-567390b5dfe4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:17.591786 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-483c951a-3c76-48fe-a740-567390b5dfe4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:17.592544 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-483c951a-3c76-48fe-a740-567390b5dfe4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:17.593593 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-483c951a-3c76-48fe-a740-567390b5dfe4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:17.594408 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-483c951a-3c76-48fe-a740-567390b5dfe4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:17.595165 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-483c951a-3c76-48fe-a740-567390b5dfe4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:17.776362 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-2a7f0828-ddc1-4745-86f9-b21254476519 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:17.793937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-2a7f0828-ddc1-4745-86f9-b21254476519 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:17.795881 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-2a7f0828-ddc1-4745-86f9-b21254476519 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:17.797110 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-2a7f0828-ddc1-4745-86f9-b21254476519 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1739 microversion: 2.20 time: 0.306728 Aug 24 17:55:17.805405 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 440/882] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:17 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:17.922766 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-483c951a-3c76-48fe-a740-567390b5dfe4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:17.922766 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-483c951a-3c76-48fe-a740-567390b5dfe4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1689 microversion: 2.1 time: 0.316875 Aug 24 17:55:17.922766 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 443/883] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:17 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1689 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:18.821138 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-9a0d19cd-1dc8-475a-bc15-c7186be0320a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:18.821805 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-9a0d19cd-1dc8-475a-bc15-c7186be0320a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:18.828906 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9a0d19cd-1dc8-475a-bc15-c7186be0320a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:18.829399 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9a0d19cd-1dc8-475a-bc15-c7186be0320a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:18.829840 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9a0d19cd-1dc8-475a-bc15-c7186be0320a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:18.830582 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9a0d19cd-1dc8-475a-bc15-c7186be0320a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:18.831040 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9a0d19cd-1dc8-475a-bc15-c7186be0320a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:18.831473 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9a0d19cd-1dc8-475a-bc15-c7186be0320a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:18.909709 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-109893f5-6223-4992-9db4-bdcca88e69a7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:18.911123 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-109893f5-6223-4992-9db4-bdcca88e69a7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:18.914246 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:18.920395 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-109893f5-6223-4992-9db4-bdcca88e69a7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:18.920887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-109893f5-6223-4992-9db4-bdcca88e69a7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:18.921323 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-109893f5-6223-4992-9db4-bdcca88e69a7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:18.922062 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-109893f5-6223-4992-9db4-bdcca88e69a7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:18.922517 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-109893f5-6223-4992-9db4-bdcca88e69a7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:18.923037 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-109893f5-6223-4992-9db4-bdcca88e69a7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:19.009469 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-9a0d19cd-1dc8-475a-bc15-c7186be0320a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:19.018464 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-9a0d19cd-1dc8-475a-bc15-c7186be0320a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:19.020215 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-9a0d19cd-1dc8-475a-bc15-c7186be0320a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:19.021389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-9a0d19cd-1dc8-475a-bc15-c7186be0320a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1739 microversion: 2.20 time: 0.204520 Aug 24 17:55:19.021959 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 441/884] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:18 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:19.082476 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-109893f5-6223-4992-9db4-bdcca88e69a7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:19.090924 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-109893f5-6223-4992-9db4-bdcca88e69a7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1689 microversion: 2.1 time: 0.185574 Aug 24 17:55:19.091508 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 444/885] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:18 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:20.060184 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-2bf604b1-090a-4c88-8066-53a91d239d89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:20.060807 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-2bf604b1-090a-4c88-8066-53a91d239d89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:20.067962 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2bf604b1-090a-4c88-8066-53a91d239d89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:20.068447 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2bf604b1-090a-4c88-8066-53a91d239d89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:20.068937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2bf604b1-090a-4c88-8066-53a91d239d89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:20.069641 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2bf604b1-090a-4c88-8066-53a91d239d89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:20.070135 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2bf604b1-090a-4c88-8066-53a91d239d89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:20.070611 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2bf604b1-090a-4c88-8066-53a91d239d89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:20.114728 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-062ffb34-1f4e-4723-a601-8449b3157e27 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:20.115350 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-062ffb34-1f4e-4723-a601-8449b3157e27 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:20.127622 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-062ffb34-1f4e-4723-a601-8449b3157e27 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:20.128297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-062ffb34-1f4e-4723-a601-8449b3157e27 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:20.128890 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-062ffb34-1f4e-4723-a601-8449b3157e27 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:20.129776 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-062ffb34-1f4e-4723-a601-8449b3157e27 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:20.130385 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-062ffb34-1f4e-4723-a601-8449b3157e27 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:20.130951 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-062ffb34-1f4e-4723-a601-8449b3157e27 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:20.136238 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:20.326434 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-2bf604b1-090a-4c88-8066-53a91d239d89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:20.330423 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:20.338191 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-2bf604b1-090a-4c88-8066-53a91d239d89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:20.340696 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-2bf604b1-090a-4c88-8066-53a91d239d89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:20.342053 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-2bf604b1-090a-4c88-8066-53a91d239d89 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1739 microversion: 2.20 time: 0.286702 Aug 24 17:55:20.342906 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 442/886] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:20 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1739 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:20.399557 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-062ffb34-1f4e-4723-a601-8449b3157e27 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:20.410629 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-062ffb34-1f4e-4723-a601-8449b3157e27 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1689 microversion: 2.1 time: 0.300873 Aug 24 17:55:20.411233 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 445/887] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:20 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1689 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:21.371621 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-79357424-a170-4731-9191-5da58f18bf59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:21.372717 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-79357424-a170-4731-9191-5da58f18bf59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:21.385601 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-79357424-a170-4731-9191-5da58f18bf59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:21.387105 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-79357424-a170-4731-9191-5da58f18bf59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:21.387887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-79357424-a170-4731-9191-5da58f18bf59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:21.398235 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-79357424-a170-4731-9191-5da58f18bf59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:21.398235 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-79357424-a170-4731-9191-5da58f18bf59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:21.398235 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-79357424-a170-4731-9191-5da58f18bf59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:21.433833 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-5b9273fe-bd1d-47f7-b764-926d8867e97b req-b80605aa-7c1e-487a-9e3f-5595aa3641a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d27bf857-8c45-4e91-b69c-a5ff394f502b", "name": "network-vif-deleted", "tag": "6d25f4e4-bb42-4107-b7a2-69620f7c6955"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:21.446401 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-5b9273fe-bd1d-47f7-b764-926d8867e97b req-b80605aa-7c1e-487a-9e3f-5595aa3641a0 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:21.447271 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-5b9273fe-bd1d-47f7-b764-926d8867e97b req-b80605aa-7c1e-487a-9e3f-5595aa3641a0 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:21.447940 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-5b9273fe-bd1d-47f7-b764-926d8867e97b req-b80605aa-7c1e-487a-9e3f-5595aa3641a0 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:21.463501 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-5b9273fe-bd1d-47f7-b764-926d8867e97b req-b80605aa-7c1e-487a-9e3f-5595aa3641a0 service nova] Creating event network-vif-deleted:6d25f4e4-bb42-4107-b7a2-69620f7c6955 for instance d27bf857-8c45-4e91-b69c-a5ff394f502b on hv-cinder-85442 Aug 24 17:55:21.470296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-5b9273fe-bd1d-47f7-b764-926d8867e97b req-b80605aa-7c1e-487a-9e3f-5595aa3641a0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121519 Aug 24 17:55:21.471253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 443/888] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:21.477444 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-2286bd11-b867-4bd1-8a67-a357b72930d6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:21.478548 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-2286bd11-b867-4bd1-8a67-a357b72930d6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:21.487046 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2286bd11-b867-4bd1-8a67-a357b72930d6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:21.487944 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2286bd11-b867-4bd1-8a67-a357b72930d6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:21.488611 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2286bd11-b867-4bd1-8a67-a357b72930d6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:21.489906 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2286bd11-b867-4bd1-8a67-a357b72930d6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:21.490679 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2286bd11-b867-4bd1-8a67-a357b72930d6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:21.491331 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2286bd11-b867-4bd1-8a67-a357b72930d6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:21.608604 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-2286bd11-b867-4bd1-8a67-a357b72930d6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:21.622039 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-2286bd11-b867-4bd1-8a67-a357b72930d6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1622 microversion: 2.1 time: 0.148933 Aug 24 17:55:21.623185 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 444/889] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:21 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1622 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:21.646862 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-79357424-a170-4731-9191-5da58f18bf59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:21.662564 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-79357424-a170-4731-9191-5da58f18bf59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:21.665653 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-79357424-a170-4731-9191-5da58f18bf59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:21.668098 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-79357424-a170-4731-9191-5da58f18bf59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1721 microversion: 2.20 time: 0.303678 Aug 24 17:55:21.669114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 446/890] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:21 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1721 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:55:22.648706 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5f1e9424-3880-4111-8100-73f987e47cf0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:22.650173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5f1e9424-3880-4111-8100-73f987e47cf0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:22.662806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5f1e9424-3880-4111-8100-73f987e47cf0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:22.663313 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5f1e9424-3880-4111-8100-73f987e47cf0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:22.664170 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5f1e9424-3880-4111-8100-73f987e47cf0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:22.664919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5f1e9424-3880-4111-8100-73f987e47cf0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:22.665392 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5f1e9424-3880-4111-8100-73f987e47cf0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:22.665825 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5f1e9424-3880-4111-8100-73f987e47cf0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:22.708869 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-765bf35c-0ebc-46e8-a802-daf92d5928ca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:22.710424 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-765bf35c-0ebc-46e8-a802-daf92d5928ca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:22.717981 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-765bf35c-0ebc-46e8-a802-daf92d5928ca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:22.725660 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-765bf35c-0ebc-46e8-a802-daf92d5928ca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:22.726274 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-765bf35c-0ebc-46e8-a802-daf92d5928ca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:22.727039 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-765bf35c-0ebc-46e8-a802-daf92d5928ca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:22.727521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-765bf35c-0ebc-46e8-a802-daf92d5928ca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:22.727964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-765bf35c-0ebc-46e8-a802-daf92d5928ca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:22.926016 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5f1e9424-3880-4111-8100-73f987e47cf0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:22.935924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5f1e9424-3880-4111-8100-73f987e47cf0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 200 len: 1330 microversion: 2.1 time: 0.296336 Aug 24 17:55:22.936960 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 445/891] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:22 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 1330 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:23.029528 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-765bf35c-0ebc-46e8-a802-daf92d5928ca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:23.038051 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-765bf35c-0ebc-46e8-a802-daf92d5928ca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:23.039554 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-765bf35c-0ebc-46e8-a802-daf92d5928ca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:23.040737 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-765bf35c-0ebc-46e8-a802-daf92d5928ca tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1721 microversion: 2.20 time: 0.335867 Aug 24 17:55:23.041278 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 447/892] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:22 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1721 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:55:23.958273 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-cacab4af-203d-4f5a-8d6c-64dde63b7ea1 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:23.958957 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-cacab4af-203d-4f5a-8d6c-64dde63b7ea1 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: d27bf857-8c45-4e91-b69c-a5ff394f502b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:23.966130 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cacab4af-203d-4f5a-8d6c-64dde63b7ea1 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:23.966612 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cacab4af-203d-4f5a-8d6c-64dde63b7ea1 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:23.967049 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cacab4af-203d-4f5a-8d6c-64dde63b7ea1 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:23.967742 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cacab4af-203d-4f5a-8d6c-64dde63b7ea1 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:23.968196 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cacab4af-203d-4f5a-8d6c-64dde63b7ea1 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:23.968616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cacab4af-203d-4f5a-8d6c-64dde63b7ea1 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:23.982976 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-cacab4af-203d-4f5a-8d6c-64dde63b7ea1 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] HTTP exception thrown: Instance d27bf857-8c45-4e91-b69c-a5ff394f502b could not be found. Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-cacab4af-203d-4f5a-8d6c-64dde63b7ea1 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Request method failure captured: Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b HTTP/1.1 Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmT-a9KYb466OD5Drv3Xz81qZyGQfXkbOB6dEp6k723KOUCx26OY7I-Uf1faS7dYmQ0QJhOLKeYvP_LQ2isazwrorVarlgJCG3lZ3XKvf8uWsndZrl9kdWhNBejxIoqjEkYfxmZxCfSO2IVsERdDLdkIV3PCifqVzvgcWT1JLc6EnfM Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 151e9d2b290047e8acd9468c721b9dd3 Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1512152156 Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:55:23.984627 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:55:23.986214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/151e9d2b290047e8acd9468c721b9dd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/151e9d2b290047e8acd9468c721b9dd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_151e9d2b290047e8acd9468c721b9dd3", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/151e9d2b290047e8acd9468c721b9dd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:55:23.986214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1512152156 Aug 24 17:55:23.986214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 151e9d2b290047e8acd9468c721b9dd3 Aug 24 17:55:23.986214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1512152156 Aug 24 17:55:23.986214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-ServerRescueNegativeTestJSON-1512152156-project Aug 24 17:55:23.986214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:55:23.986214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:55:23.986214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 63ff0ea67ee64e14aafc5c51cad9684f Aug 24 17:55:23.986214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1512152156-project Aug 24 17:55:23.986214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:55:23.986214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance d27bf857-8c45-4e91-b69c-a5ff394f502b could not be found. Aug 24 17:55:23.986214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': 'd27bf857-8c45-4e91-b69c-a5ff394f502b'} Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d27bf857-8c45-4e91-b69c-a5ff394f502b could not be found. Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:23.987125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:23.988486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:23.988486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:55:23.988486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:55:23.988486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:55:23.988486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:55:23.988486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:55:23.988486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:55:23.988486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d27bf857-8c45-4e91-b69c-a5ff394f502b could not be found. Aug 24 17:55:23.988486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:23.988486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:23.988486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:23.988486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:23.988486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:23.988486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:23.988486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:55:23.988486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:55:23.988486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d27bf857-8c45-4e91-b69c-a5ff394f502b could not be found. Aug 24 17:55:23.988486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:23.989769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-cacab4af-203d-4f5a-8d6c-64dde63b7ea1 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Returning 404 to user: Instance d27bf857-8c45-4e91-b69c-a5ff394f502b could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:23.989769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-cacab4af-203d-4f5a-8d6c-64dde63b7ea1 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b" status: 404 len: 111 microversion: 2.1 time: 0.032096 Aug 24 17:55:23.989769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 446/893] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:23 2022] GET /compute/v2.1/servers/d27bf857-8c45-4e91-b69c-a5ff394f502b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:55:23.996284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e354599a-cacd-4427-a445-df5e498faa9a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '.version_select at 0x7fce77295dc0>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:24.065133 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-2eacd859-d452-460c-9deb-fd11ad511d59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:24.065928 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-2eacd859-d452-460c-9deb-fd11ad511d59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:24.072089 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2eacd859-d452-460c-9deb-fd11ad511d59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:24.074036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2eacd859-d452-460c-9deb-fd11ad511d59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:24.074036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2eacd859-d452-460c-9deb-fd11ad511d59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:24.074266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2eacd859-d452-460c-9deb-fd11ad511d59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:24.074368 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-e354599a-cacd-4427-a445-df5e498faa9a tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-826942031" status: 202 len: 0 microversion: 2.1 time: 0.082151 Aug 24 17:55:24.074724 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2eacd859-d452-460c-9deb-fd11ad511d59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:24.075334 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 448/894] 10.222.0.76 () {58 vars in 1218 bytes} [Wed Aug 24 17:55:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-826942031 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:55:24.075464 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2eacd859-d452-460c-9deb-fd11ad511d59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:24.102943 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-00526fae-6c9e-44e4-87ac-c5a66694facb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:24.108272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-00526fae-6c9e-44e4-87ac-c5a66694facb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:24.110658 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-00526fae-6c9e-44e4-87ac-c5a66694facb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:24.111143 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-00526fae-6c9e-44e4-87ac-c5a66694facb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:24.111756 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-00526fae-6c9e-44e4-87ac-c5a66694facb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:24.112665 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-00526fae-6c9e-44e4-87ac-c5a66694facb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:24.113122 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-00526fae-6c9e-44e4-87ac-c5a66694facb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:24.113546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-00526fae-6c9e-44e4-87ac-c5a66694facb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:24.140847 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-00526fae-6c9e-44e4-87ac-c5a66694facb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Going to try to terminate instance {{(pid=127677) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:55:24.229533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-2eacd859-d452-460c-9deb-fd11ad511d59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:24.239247 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-2eacd859-d452-460c-9deb-fd11ad511d59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:24.241048 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-2eacd859-d452-460c-9deb-fd11ad511d59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:24.242304 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-2eacd859-d452-460c-9deb-fd11ad511d59 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1664 microversion: 2.20 time: 0.181224 Aug 24 17:55:24.242852 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 447/895] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:24 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1664 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:24.271811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-4c6a139d-4fab-4860-a01b-4cbef417419f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48d98b18-57d9-42b7-b310-f90ba6e1aacf"}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:24.274257 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4c6a139d-4fab-4860-a01b-4cbef417419f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:24.281291 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4c6a139d-4fab-4860-a01b-4cbef417419f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:24.281778 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4c6a139d-4fab-4860-a01b-4cbef417419f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:24.282246 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4c6a139d-4fab-4860-a01b-4cbef417419f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:24.282961 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4c6a139d-4fab-4860-a01b-4cbef417419f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:24.283418 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4c6a139d-4fab-4860-a01b-4cbef417419f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:24.283847 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4c6a139d-4fab-4860-a01b-4cbef417419f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:24.433824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-00526fae-6c9e-44e4-87ac-c5a66694facb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "DELETE /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 204 len: 0 microversion: 2.1 time: 0.330414 Aug 24 17:55:24.433824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 449/896] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:55:24 2022] DELETE /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:55:24.439584 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1477da1d-d3a8-45ac-9613-faf6eb4305b7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:24.440313 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1477da1d-d3a8-45ac-9613-faf6eb4305b7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:24.447938 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1477da1d-d3a8-45ac-9613-faf6eb4305b7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:24.449199 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1477da1d-d3a8-45ac-9613-faf6eb4305b7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:24.449831 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1477da1d-d3a8-45ac-9613-faf6eb4305b7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:24.450786 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1477da1d-d3a8-45ac-9613-faf6eb4305b7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:24.451556 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1477da1d-d3a8-45ac-9613-faf6eb4305b7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:24.452093 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1477da1d-d3a8-45ac-9613-faf6eb4305b7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:24.689767 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1477da1d-d3a8-45ac-9613-faf6eb4305b7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:24.694836 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1477da1d-d3a8-45ac-9613-faf6eb4305b7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1579 microversion: 2.1 time: 0.259429 Aug 24 17:55:24.695428 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 450/897] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:24 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1579 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:25.537421 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-4c6a139d-4fab-4860-a01b-4cbef417419f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "POST /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.269830 Aug 24 17:55:25.540893 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 448/898] 10.222.0.76 () {62 vars in 1364 bytes} [Wed Aug 24 17:55:24 2022] POST /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4/os-volume_attachments => generated 188 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:55:25.575114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-72697a43-306a-4880-b3ad-a6652896e7ed req-f3a46c17-463d-4134-8ac4-c0f730373ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861f638b-1bdf-459e-bf10-2846d8994ac4", "name": "network-vif-unplugged", "status": "completed", "tag": "83c659e2-8827-4402-9131-6edb2b9b0a44"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:25.594623 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-72697a43-306a-4880-b3ad-a6652896e7ed req-f3a46c17-463d-4134-8ac4-c0f730373ab2 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:25.595426 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-72697a43-306a-4880-b3ad-a6652896e7ed req-f3a46c17-463d-4134-8ac4-c0f730373ab2 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:25.596142 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-72697a43-306a-4880-b3ad-a6652896e7ed req-f3a46c17-463d-4134-8ac4-c0f730373ab2 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:25.616284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.compute.server_external_events [req-72697a43-306a-4880-b3ad-a6652896e7ed req-f3a46c17-463d-4134-8ac4-c0f730373ab2 service nova] Unable to find a host for instance 861f638b-1bdf-459e-bf10-2846d8994ac4. Dropping event network-vif-unplugged {{(pid=127677) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 17:55:25.617242 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-72697a43-306a-4880-b3ad-a6652896e7ed req-f3a46c17-463d-4134-8ac4-c0f730373ab2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.051892 Aug 24 17:55:25.618172 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 451/899] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 53 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 17:55:25.703370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e2cc76c7-45e4-4eab-873f-861b51eb43df tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:25.704299 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e2cc76c7-45e4-4eab-873f-861b51eb43df tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:25.713259 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e2cc76c7-45e4-4eab-873f-861b51eb43df tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:25.714816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e2cc76c7-45e4-4eab-873f-861b51eb43df tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:25.715550 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e2cc76c7-45e4-4eab-873f-861b51eb43df tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:25.716704 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e2cc76c7-45e4-4eab-873f-861b51eb43df tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:25.717455 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e2cc76c7-45e4-4eab-873f-861b51eb43df tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:25.718197 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e2cc76c7-45e4-4eab-873f-861b51eb43df tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:25.722673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3c17b57c-6698-4964-880e-2fdfd2b6ec02 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:25.723851 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3c17b57c-6698-4964-880e-2fdfd2b6ec02 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:25.734116 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c17b57c-6698-4964-880e-2fdfd2b6ec02 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:25.738137 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c17b57c-6698-4964-880e-2fdfd2b6ec02 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:25.738690 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c17b57c-6698-4964-880e-2fdfd2b6ec02 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:25.740598 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c17b57c-6698-4964-880e-2fdfd2b6ec02 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:25.740598 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c17b57c-6698-4964-880e-2fdfd2b6ec02 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:25.740598 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3c17b57c-6698-4964-880e-2fdfd2b6ec02 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:25.893124 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3c17b57c-6698-4964-880e-2fdfd2b6ec02 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:25.901192 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3c17b57c-6698-4964-880e-2fdfd2b6ec02 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1579 microversion: 2.1 time: 0.185319 Aug 24 17:55:25.901948 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 452/900] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:25 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1579 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:26.314891 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-89fdffbc-4d32-47b0-88fc-2d24e93e3b74 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:26.315937 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-89fdffbc-4d32-47b0-88fc-2d24e93e3b74 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:26.323864 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-89fdffbc-4d32-47b0-88fc-2d24e93e3b74 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:26.326444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-89fdffbc-4d32-47b0-88fc-2d24e93e3b74 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:26.326444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-89fdffbc-4d32-47b0-88fc-2d24e93e3b74 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:26.326444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-89fdffbc-4d32-47b0-88fc-2d24e93e3b74 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:26.326784 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-89fdffbc-4d32-47b0-88fc-2d24e93e3b74 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:26.327015 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-89fdffbc-4d32-47b0-88fc-2d24e93e3b74 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:26.363206 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-89fdffbc-4d32-47b0-88fc-2d24e93e3b74 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/ips" status: 200 len: 145 microversion: 2.1 time: 0.044526 Aug 24 17:55:26.363206 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 453/901] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 24 17:55:26 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:55:26.478640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e2cc76c7-45e4-4eab-873f-861b51eb43df tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "DELETE /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4/os-volume_attachments/48d98b18-57d9-42b7-b310-f90ba6e1aacf" status: 202 len: 0 microversion: 2.20 time: 0.781112 Aug 24 17:55:26.481114 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 449/902] 10.222.0.76 () {60 vars in 1457 bytes} [Wed Aug 24 17:55:25 2022] DELETE /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4/os-volume_attachments/48d98b18-57d9-42b7-b310-f90ba6e1aacf => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:55:26.583202 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-8bbd96f6-125b-464f-8e61-848538f81b68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:26.584523 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-8bbd96f6-125b-464f-8e61-848538f81b68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:26.596358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8bbd96f6-125b-464f-8e61-848538f81b68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:26.597026 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8bbd96f6-125b-464f-8e61-848538f81b68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:26.597884 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8bbd96f6-125b-464f-8e61-848538f81b68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:26.598818 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8bbd96f6-125b-464f-8e61-848538f81b68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:26.599441 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8bbd96f6-125b-464f-8e61-848538f81b68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:26.600093 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8bbd96f6-125b-464f-8e61-848538f81b68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:26.653455 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-8bbd96f6-125b-464f-8e61-848538f81b68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127677) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 17:55:26.923420 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a3bbd509-24ea-48d6-977a-cfcf38d6ba2c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:26.923804 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a3bbd509-24ea-48d6-977a-cfcf38d6ba2c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:26.930936 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a3bbd509-24ea-48d6-977a-cfcf38d6ba2c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:26.931583 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a3bbd509-24ea-48d6-977a-cfcf38d6ba2c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:26.932218 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a3bbd509-24ea-48d6-977a-cfcf38d6ba2c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:26.933233 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a3bbd509-24ea-48d6-977a-cfcf38d6ba2c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:26.934088 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a3bbd509-24ea-48d6-977a-cfcf38d6ba2c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:26.934688 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a3bbd509-24ea-48d6-977a-cfcf38d6ba2c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:27.003914 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-8bbd96f6-125b-464f-8e61-848538f81b68 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "POST /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4/action" status: 202 len: 0 microversion: 2.20 time: 0.428509 Aug 24 17:55:27.008129 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 454/903] 10.222.0.76 () {62 vars in 1319 bytes} [Wed Aug 24 17:55:26 2022] POST /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:55:27.029661 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-30a705d4-b854-492c-acaa-01515b7bd379 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:27.030682 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-30a705d4-b854-492c-acaa-01515b7bd379 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:27.038680 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a3bbd509-24ea-48d6-977a-cfcf38d6ba2c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:27.039579 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-30a705d4-b854-492c-acaa-01515b7bd379 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:27.040369 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-30a705d4-b854-492c-acaa-01515b7bd379 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:27.041014 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-30a705d4-b854-492c-acaa-01515b7bd379 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:27.042800 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-30a705d4-b854-492c-acaa-01515b7bd379 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:27.043824 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-30a705d4-b854-492c-acaa-01515b7bd379 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:27.044565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-30a705d4-b854-492c-acaa-01515b7bd379 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:27.052128 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a3bbd509-24ea-48d6-977a-cfcf38d6ba2c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1511 microversion: 2.1 time: 0.132972 Aug 24 17:55:27.055275 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 450/904] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:26 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1511 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:27.297769 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-30a705d4-b854-492c-acaa-01515b7bd379 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:27.312776 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-30a705d4-b854-492c-acaa-01515b7bd379 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:27.314753 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-30a705d4-b854-492c-acaa-01515b7bd379 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:27.316311 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-30a705d4-b854-492c-acaa-01515b7bd379 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1672 microversion: 2.20 time: 0.302848 Aug 24 17:55:27.316762 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 455/905] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:27 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1672 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:27.377353 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-2d3368e4-387a-43ce-91c2-5935ca4f966e req-b337af9b-7ae4-4c74-a38b-ec9e9f6756a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829f4d8c-fcd5-4611-9878-af9c7b30e362", "name": "network-vif-deleted", "tag": "7aa9edde-92b1-4e33-9fe7-371de05db5c9"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:27.389207 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-2d3368e4-387a-43ce-91c2-5935ca4f966e req-b337af9b-7ae4-4c74-a38b-ec9e9f6756a7 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:27.389758 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-2d3368e4-387a-43ce-91c2-5935ca4f966e req-b337af9b-7ae4-4c74-a38b-ec9e9f6756a7 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:27.390236 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-2d3368e4-387a-43ce-91c2-5935ca4f966e req-b337af9b-7ae4-4c74-a38b-ec9e9f6756a7 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:27.406563 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-2d3368e4-387a-43ce-91c2-5935ca4f966e req-b337af9b-7ae4-4c74-a38b-ec9e9f6756a7 service nova] Creating event network-vif-deleted:7aa9edde-92b1-4e33-9fe7-371de05db5c9 for instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 on hv-cinder-85442 Aug 24 17:55:27.410346 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-2d3368e4-387a-43ce-91c2-5935ca4f966e req-b337af9b-7ae4-4c74-a38b-ec9e9f6756a7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037095 Aug 24 17:55:27.411264 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 451/906] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:27.940725 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-b3d64703-1f0c-4f90-9a30-c8770a8673a4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:27.941323 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-b3d64703-1f0c-4f90-9a30-c8770a8673a4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:27.954028 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b3d64703-1f0c-4f90-9a30-c8770a8673a4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:27.954028 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b3d64703-1f0c-4f90-9a30-c8770a8673a4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:27.954028 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b3d64703-1f0c-4f90-9a30-c8770a8673a4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:27.954028 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b3d64703-1f0c-4f90-9a30-c8770a8673a4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:27.954592 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b3d64703-1f0c-4f90-9a30-c8770a8673a4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:27.954702 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b3d64703-1f0c-4f90-9a30-c8770a8673a4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:27.988452 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-b3d64703-1f0c-4f90-9a30-c8770a8673a4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Going to try to terminate instance {{(pid=127677) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:55:28.075893 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-535865cf-668e-4d0f-b0e4-af410ed6f908 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:28.076815 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-535865cf-668e-4d0f-b0e4-af410ed6f908 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:28.096487 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-535865cf-668e-4d0f-b0e4-af410ed6f908 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:28.096981 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-535865cf-668e-4d0f-b0e4-af410ed6f908 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:28.097421 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-535865cf-668e-4d0f-b0e4-af410ed6f908 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:28.098171 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-535865cf-668e-4d0f-b0e4-af410ed6f908 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:28.098634 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-535865cf-668e-4d0f-b0e4-af410ed6f908 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:28.099075 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-535865cf-668e-4d0f-b0e4-af410ed6f908 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:28.145693 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-535865cf-668e-4d0f-b0e4-af410ed6f908 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:28.146343 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-535865cf-668e-4d0f-b0e4-af410ed6f908 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:28.146773 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-535865cf-668e-4d0f-b0e4-af410ed6f908 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:28.147622 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-535865cf-668e-4d0f-b0e4-af410ed6f908 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lazy-loading 'fault' on Instance uuid 829f4d8c-fcd5-4611-9878-af9c7b30e362 {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:55:28.204360 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-535865cf-668e-4d0f-b0e4-af410ed6f908 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:28.212798 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-535865cf-668e-4d0f-b0e4-af410ed6f908 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1231 microversion: 2.1 time: 0.142183 Aug 24 17:55:28.213395 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 452/907] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:28 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1231 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:28.218968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-9b01c221-95d8-4df7-8707-1e144de99a93 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2bdcc61-a323-42b9-9488-c9fc92c74550"}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:28.221341 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-9b01c221-95d8-4df7-8707-1e144de99a93 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:28.232197 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9b01c221-95d8-4df7-8707-1e144de99a93 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:28.232817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9b01c221-95d8-4df7-8707-1e144de99a93 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:28.233334 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9b01c221-95d8-4df7-8707-1e144de99a93 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:28.234156 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9b01c221-95d8-4df7-8707-1e144de99a93 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:28.239470 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9b01c221-95d8-4df7-8707-1e144de99a93 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:28.239470 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9b01c221-95d8-4df7-8707-1e144de99a93 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:28.311915 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-b3d64703-1f0c-4f90-9a30-c8770a8673a4 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 204 len: 0 microversion: 2.1 time: 0.374803 Aug 24 17:55:28.314855 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 456/908] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:55:27 2022] DELETE /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:55:28.333078 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c04f9d60-30ca-4b02-b924-d439b413937b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:28.337841 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c04f9d60-30ca-4b02-b924-d439b413937b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:28.352573 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c04f9d60-30ca-4b02-b924-d439b413937b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:28.353630 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c04f9d60-30ca-4b02-b924-d439b413937b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:28.354529 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c04f9d60-30ca-4b02-b924-d439b413937b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:28.360603 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c04f9d60-30ca-4b02-b924-d439b413937b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:28.360603 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c04f9d60-30ca-4b02-b924-d439b413937b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:28.360603 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c04f9d60-30ca-4b02-b924-d439b413937b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:28.525013 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c04f9d60-30ca-4b02-b924-d439b413937b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:28.533445 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c04f9d60-30ca-4b02-b924-d439b413937b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1507 microversion: 2.1 time: 0.211938 Aug 24 17:55:28.534114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 457/909] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:28 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:28.539450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-5537234a-3e7e-4aea-9597-132abe512350 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:28.540300 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-5537234a-3e7e-4aea-9597-132abe512350 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:28.547169 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5537234a-3e7e-4aea-9597-132abe512350 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:28.547833 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5537234a-3e7e-4aea-9597-132abe512350 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:28.548083 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5537234a-3e7e-4aea-9597-132abe512350 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:28.548798 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5537234a-3e7e-4aea-9597-132abe512350 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:28.549264 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5537234a-3e7e-4aea-9597-132abe512350 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:28.550227 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5537234a-3e7e-4aea-9597-132abe512350 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:28.696596 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5537234a-3e7e-4aea-9597-132abe512350 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:28.705646 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5537234a-3e7e-4aea-9597-132abe512350 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:28.707179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5537234a-3e7e-4aea-9597-132abe512350 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:28.708390 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-5537234a-3e7e-4aea-9597-132abe512350 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1672 microversion: 2.20 time: 0.172992 Aug 24 17:55:28.709005 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 458/910] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:28 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1672 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:29.235734 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-828aea5f-be0d-4eb7-8145-aeac6ebe19fc tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:29.236416 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-828aea5f-be0d-4eb7-8145-aeac6ebe19fc tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:29.243127 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-828aea5f-be0d-4eb7-8145-aeac6ebe19fc tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:29.243614 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-828aea5f-be0d-4eb7-8145-aeac6ebe19fc tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:29.244059 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-828aea5f-be0d-4eb7-8145-aeac6ebe19fc tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:29.244765 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-828aea5f-be0d-4eb7-8145-aeac6ebe19fc tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:29.245708 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-828aea5f-be0d-4eb7-8145-aeac6ebe19fc tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:29.246300 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-828aea5f-be0d-4eb7-8145-aeac6ebe19fc tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:29.420737 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:29.434419 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-828aea5f-be0d-4eb7-8145-aeac6ebe19fc tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:29.434897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-828aea5f-be0d-4eb7-8145-aeac6ebe19fc tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:29.435326 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-828aea5f-be0d-4eb7-8145-aeac6ebe19fc tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:29.435774 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-828aea5f-be0d-4eb7-8145-aeac6ebe19fc tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lazy-loading 'fault' on Instance uuid 829f4d8c-fcd5-4611-9878-af9c7b30e362 {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:55:29.484903 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-828aea5f-be0d-4eb7-8145-aeac6ebe19fc tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:29.494212 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-828aea5f-be0d-4eb7-8145-aeac6ebe19fc tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1231 microversion: 2.1 time: 0.262321 Aug 24 17:55:29.494801 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 459/911] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:29 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1231 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:29.555098 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-59d3ceb6-d699-40ab-9515-5490a014a3e7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:29.555695 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-59d3ceb6-d699-40ab-9515-5490a014a3e7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:29.562957 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-59d3ceb6-d699-40ab-9515-5490a014a3e7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:29.569797 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-59d3ceb6-d699-40ab-9515-5490a014a3e7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:29.569797 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-59d3ceb6-d699-40ab-9515-5490a014a3e7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:29.569797 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-59d3ceb6-d699-40ab-9515-5490a014a3e7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:29.569797 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-59d3ceb6-d699-40ab-9515-5490a014a3e7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:29.570241 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-59d3ceb6-d699-40ab-9515-5490a014a3e7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:29.705776 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-59d3ceb6-d699-40ab-9515-5490a014a3e7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:29.713540 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-59d3ceb6-d699-40ab-9515-5490a014a3e7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1507 microversion: 2.1 time: 0.162852 Aug 24 17:55:29.714729 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 460/912] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:29 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:29.732189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c07826b7-ec2b-4300-83a2-5617e9dacd84 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:29.732813 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c07826b7-ec2b-4300-83a2-5617e9dacd84 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:29.739437 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c07826b7-ec2b-4300-83a2-5617e9dacd84 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:29.739926 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c07826b7-ec2b-4300-83a2-5617e9dacd84 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:29.740379 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c07826b7-ec2b-4300-83a2-5617e9dacd84 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:29.741079 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c07826b7-ec2b-4300-83a2-5617e9dacd84 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:29.741517 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c07826b7-ec2b-4300-83a2-5617e9dacd84 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:29.742106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c07826b7-ec2b-4300-83a2-5617e9dacd84 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:29.889594 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c07826b7-ec2b-4300-83a2-5617e9dacd84 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:29.898622 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c07826b7-ec2b-4300-83a2-5617e9dacd84 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:29.900114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c07826b7-ec2b-4300-83a2-5617e9dacd84 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:29.901323 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c07826b7-ec2b-4300-83a2-5617e9dacd84 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1672 microversion: 2.20 time: 0.173287 Aug 24 17:55:29.902322 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 461/913] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:29 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:55:30.515210 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-b4c8c708-84bc-46ad-b47c-d420903ec75f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:30.515897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-b4c8c708-84bc-46ad-b47c-d420903ec75f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:30.522736 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b4c8c708-84bc-46ad-b47c-d420903ec75f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:30.523219 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b4c8c708-84bc-46ad-b47c-d420903ec75f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:30.523688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b4c8c708-84bc-46ad-b47c-d420903ec75f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:30.524389 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b4c8c708-84bc-46ad-b47c-d420903ec75f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:30.524861 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b4c8c708-84bc-46ad-b47c-d420903ec75f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:30.525284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b4c8c708-84bc-46ad-b47c-d420903ec75f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:30.561376 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b4c8c708-84bc-46ad-b47c-d420903ec75f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:30.561880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b4c8c708-84bc-46ad-b47c-d420903ec75f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:30.562322 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b4c8c708-84bc-46ad-b47c-d420903ec75f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:30.562769 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-b4c8c708-84bc-46ad-b47c-d420903ec75f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lazy-loading 'fault' on Instance uuid 829f4d8c-fcd5-4611-9878-af9c7b30e362 {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:55:30.618224 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-b4c8c708-84bc-46ad-b47c-d420903ec75f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:30.627283 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-b4c8c708-84bc-46ad-b47c-d420903ec75f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 200 len: 1185 microversion: 2.1 time: 0.115331 Aug 24 17:55:30.628142 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 462/914] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:30 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 1185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:30.736191 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-650e6726-d4a8-434d-bb4a-93ca7163ac45 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:30.736802 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-650e6726-d4a8-434d-bb4a-93ca7163ac45 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:30.743200 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-650e6726-d4a8-434d-bb4a-93ca7163ac45 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:30.747155 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-650e6726-d4a8-434d-bb4a-93ca7163ac45 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:30.747155 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-650e6726-d4a8-434d-bb4a-93ca7163ac45 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:30.747155 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-650e6726-d4a8-434d-bb4a-93ca7163ac45 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:30.747155 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-650e6726-d4a8-434d-bb4a-93ca7163ac45 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:30.747790 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-650e6726-d4a8-434d-bb4a-93ca7163ac45 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:30.969623 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-650e6726-d4a8-434d-bb4a-93ca7163ac45 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:30.979002 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-650e6726-d4a8-434d-bb4a-93ca7163ac45 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1507 microversion: 2.1 time: 0.246573 Aug 24 17:55:30.980253 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 463/915] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:30 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:30.994057 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a99c986d-7a81-46aa-ab44-8bdfa65a477a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:31.000716 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a99c986d-7a81-46aa-ab44-8bdfa65a477a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:31.004250 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a99c986d-7a81-46aa-ab44-8bdfa65a477a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:31.004899 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a99c986d-7a81-46aa-ab44-8bdfa65a477a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:31.005353 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a99c986d-7a81-46aa-ab44-8bdfa65a477a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:31.006118 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a99c986d-7a81-46aa-ab44-8bdfa65a477a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:31.006809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a99c986d-7a81-46aa-ab44-8bdfa65a477a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:31.007009 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a99c986d-7a81-46aa-ab44-8bdfa65a477a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:31.188541 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-9b01c221-95d8-4df7-8707-1e144de99a93 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "POST /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.973795 Aug 24 17:55:31.191482 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 453/916] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 17:55:28 2022] POST /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments => generated 194 bytes in 2975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:31.255167 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a99c986d-7a81-46aa-ab44-8bdfa65a477a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:31.264602 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a99c986d-7a81-46aa-ab44-8bdfa65a477a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:31.266149 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a99c986d-7a81-46aa-ab44-8bdfa65a477a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:31.267329 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a99c986d-7a81-46aa-ab44-8bdfa65a477a tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1730 microversion: 2.20 time: 0.286403 Aug 24 17:55:31.267915 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 464/917] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:30 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1730 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:31.584006 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-ee0d8416-d002-4591-be6f-dc929797f4fe req-e90c972b-2cff-4ba1-865b-6172610664e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1deb7e5-c813-4c8b-829e-3c38e10fde3b", "name": "network-vif-deleted", "tag": "cc4b347c-0dc2-4c02-b53f-f642a08163d3"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:31.597589 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-ee0d8416-d002-4591-be6f-dc929797f4fe req-e90c972b-2cff-4ba1-865b-6172610664e6 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:31.598365 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-ee0d8416-d002-4591-be6f-dc929797f4fe req-e90c972b-2cff-4ba1-865b-6172610664e6 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:31.598794 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-ee0d8416-d002-4591-be6f-dc929797f4fe req-e90c972b-2cff-4ba1-865b-6172610664e6 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:31.610875 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-ee0d8416-d002-4591-be6f-dc929797f4fe req-e90c972b-2cff-4ba1-865b-6172610664e6 service nova] Creating event network-vif-deleted:cc4b347c-0dc2-4c02-b53f-f642a08163d3 for instance e1deb7e5-c813-4c8b-829e-3c38e10fde3b on hv-cinder-85442 Aug 24 17:55:31.616219 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-ee0d8416-d002-4591-be6f-dc929797f4fe req-e90c972b-2cff-4ba1-865b-6172610664e6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037291 Aug 24 17:55:31.625258 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 454/918] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:31.650881 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-6fb3dbe4-2bfa-494d-8b26-fb5f5f1ed458 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:31.652314 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-6fb3dbe4-2bfa-494d-8b26-fb5f5f1ed458 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:31.660984 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6fb3dbe4-2bfa-494d-8b26-fb5f5f1ed458 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:31.661971 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6fb3dbe4-2bfa-494d-8b26-fb5f5f1ed458 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:31.662585 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6fb3dbe4-2bfa-494d-8b26-fb5f5f1ed458 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:31.663288 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6fb3dbe4-2bfa-494d-8b26-fb5f5f1ed458 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:31.663895 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6fb3dbe4-2bfa-494d-8b26-fb5f5f1ed458 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:31.664483 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6fb3dbe4-2bfa-494d-8b26-fb5f5f1ed458 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:31.687673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-6fb3dbe4-2bfa-494d-8b26-fb5f5f1ed458 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] HTTP exception thrown: Instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 could not be found. Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-6fb3dbe4-2bfa-494d-8b26-fb5f5f1ed458 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Request method failure captured: Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 HTTP/1.1 Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmVA6wpgWgaeWvIIIWR-Jnwuaby9_LW__hON31Wmek0wwA_G9g0PcV8zZD3Ov7jBKLDqlxceRmll4WtLGzInSNHsIgXEU7V2yvuqfcZdtzTnh57HfCEIW3f8Bd3Rh4vUpggBSYTaN_W7YjICamzEPDRiyKwLqJFKIDR64uO2kEoLkKg Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 54cebab3bf1f440dbaa4ef020177a4bb Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-TestVolumeBootPattern-1322010073 Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:55:31.690358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:55:31.691897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/54cebab3bf1f440dbaa4ef020177a4bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/54cebab3bf1f440dbaa4ef020177a4bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_54cebab3bf1f440dbaa4ef020177a4bb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/54cebab3bf1f440dbaa4ef020177a4bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:55:31.691897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-TestVolumeBootPattern-1322010073 Aug 24 17:55:31.691897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 54cebab3bf1f440dbaa4ef020177a4bb Aug 24 17:55:31.691897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-TestVolumeBootPattern-1322010073 Aug 24 17:55:31.691897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-TestVolumeBootPattern-1322010073-project Aug 24 17:55:31.691897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:55:31.691897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:55:31.691897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: f19bf0e6a8ad425cbbf804d6d7be5a0a Aug 24 17:55:31.691897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-TestVolumeBootPattern-1322010073-project Aug 24 17:55:31.691897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:55:31.691897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 could not be found. Aug 24 17:55:31.691897 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': '829f4d8c-fcd5-4611-9878-af9c7b30e362'} Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 could not be found. Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:31.692874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:31.694381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:31.694381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:55:31.694381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:55:31.694381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:55:31.694381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:55:31.694381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:55:31.694381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:55:31.694381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 could not be found. Aug 24 17:55:31.694381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:55:31.694381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:31.694381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:55:31.694381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:31.694381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:31.694381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:31.694381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:55:31.694381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:55:31.694381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 could not be found. Aug 24 17:55:31.694381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:55:31.695767 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-6fb3dbe4-2bfa-494d-8b26-fb5f5f1ed458 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Returning 404 to user: Instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:31.695767 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-6fb3dbe4-2bfa-494d-8b26-fb5f5f1ed458 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 404 len: 111 microversion: 2.1 time: 0.046107 Aug 24 17:55:31.695767 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 465/919] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:31 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:55:31.844750 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-04e18c02-220a-410d-9ee8-489ee582eb4c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1283732439", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1931889606", "security_groups": [{"name": "tempest-secgroup-smoke-1999771964"}], "block_device_mapping_v2": [{"uuid": "1eaa4e60-2895-441a-b632-36426e3ba119", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2846555c-99d6-42dd-b3aa-b589c6b8e767"}]}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:32.021119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.network.neutron [None req-04e18c02-220a-410d-9ee8-489ee582eb4c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] validate_networks() for [('2846555c-99d6-42dd-b3aa-b589c6b8e767', None, None, None, None, None)] {{(pid=127676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:55:32.021877 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-fe9c6ef8-e823-4923-ae6d-9c3d172399e6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:32.023017 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-fe9c6ef8-e823-4923-ae6d-9c3d172399e6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:32.034830 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fe9c6ef8-e823-4923-ae6d-9c3d172399e6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:32.035780 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fe9c6ef8-e823-4923-ae6d-9c3d172399e6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:32.036533 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fe9c6ef8-e823-4923-ae6d-9c3d172399e6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:32.037562 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fe9c6ef8-e823-4923-ae6d-9c3d172399e6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:32.038457 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fe9c6ef8-e823-4923-ae6d-9c3d172399e6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:32.040078 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fe9c6ef8-e823-4923-ae6d-9c3d172399e6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:32.109671 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fe9c6ef8-e823-4923-ae6d-9c3d172399e6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:32.110105 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fe9c6ef8-e823-4923-ae6d-9c3d172399e6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:32.110555 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fe9c6ef8-e823-4923-ae6d-9c3d172399e6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:32.111015 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-fe9c6ef8-e823-4923-ae6d-9c3d172399e6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lazy-loading 'fault' on Instance uuid e1deb7e5-c813-4c8b-829e-3c38e10fde3b {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:55:32.159562 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-fe9c6ef8-e823-4923-ae6d-9c3d172399e6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:32.167754 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-fe9c6ef8-e823-4923-ae6d-9c3d172399e6 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 200 len: 1311 microversion: 2.1 time: 0.157106 Aug 24 17:55:32.168323 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 466/920] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:32 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 1311 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:32.294310 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9a0c7137-ca19-48f8-864c-eb95f9b5efb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:32.294310 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9a0c7137-ca19-48f8-864c-eb95f9b5efb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:32.303099 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9a0c7137-ca19-48f8-864c-eb95f9b5efb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:32.303967 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9a0c7137-ca19-48f8-864c-eb95f9b5efb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:32.305411 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9a0c7137-ca19-48f8-864c-eb95f9b5efb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:32.306753 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9a0c7137-ca19-48f8-864c-eb95f9b5efb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:32.308542 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9a0c7137-ca19-48f8-864c-eb95f9b5efb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:32.309246 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9a0c7137-ca19-48f8-864c-eb95f9b5efb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:32.558297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9a0c7137-ca19-48f8-864c-eb95f9b5efb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:32.569137 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9a0c7137-ca19-48f8-864c-eb95f9b5efb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:32.571055 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9a0c7137-ca19-48f8-864c-eb95f9b5efb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:32.574499 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9a0c7137-ca19-48f8-864c-eb95f9b5efb4 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1730 microversion: 2.20 time: 0.284993 Aug 24 17:55:32.575537 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 467/921] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:32 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1730 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:55:32.587871 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-04e18c02-220a-410d-9ee8-489ee582eb4c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Flavor limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:55:32.589422 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-04e18c02-220a-410d-9ee8-489ee582eb4c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Image limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:55:32.590924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-04e18c02-220a-410d-9ee8-489ee582eb4c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Flavor pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:55:32.591671 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-04e18c02-220a-410d-9ee8-489ee582eb4c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Image pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:55:32.592662 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-04e18c02-220a-410d-9ee8-489ee582eb4c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:55:32.609637 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-04e18c02-220a-410d-9ee8-489ee582eb4c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:32.610434 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-04e18c02-220a-410d-9ee8-489ee582eb4c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:32.611076 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-04e18c02-220a-410d-9ee8-489ee582eb4c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:32.612303 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-04e18c02-220a-410d-9ee8-489ee582eb4c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:32.613297 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-04e18c02-220a-410d-9ee8-489ee582eb4c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:32.614059 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-04e18c02-220a-410d-9ee8-489ee582eb4c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:32.641921 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-04e18c02-220a-410d-9ee8-489ee582eb4c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Getting quotas for project 54cebab3bf1f440dbaa4ef020177a4bb. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:55:32.646549 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-04e18c02-220a-410d-9ee8-489ee582eb4c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Getting quotas for user f19bf0e6a8ad425cbbf804d6d7be5a0a and project 54cebab3bf1f440dbaa4ef020177a4bb. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:55:32.730558 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-04e18c02-220a-410d-9ee8-489ee582eb4c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Going to run 1 instances... {{(pid=127676) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:55:32.730558 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-04e18c02-220a-410d-9ee8-489ee582eb4c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1eaa4e60-2895-441a-b632-36426e3ba119',volume_size=None,volume_type=None)] {{(pid=127676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:55:33.190279 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-fea20472-de34-4441-9f41-887a012e79ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:33.190986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-fea20472-de34-4441-9f41-887a012e79ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: e1deb7e5-c813-4c8b-829e-3c38e10fde3b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:33.204590 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fea20472-de34-4441-9f41-887a012e79ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:33.205578 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fea20472-de34-4441-9f41-887a012e79ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:33.206400 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fea20472-de34-4441-9f41-887a012e79ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:33.207962 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fea20472-de34-4441-9f41-887a012e79ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:33.208994 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fea20472-de34-4441-9f41-887a012e79ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:33.210265 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fea20472-de34-4441-9f41-887a012e79ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:33.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-fea20472-de34-4441-9f41-887a012e79ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] HTTP exception thrown: Instance e1deb7e5-c813-4c8b-829e-3c38e10fde3b could not be found. Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-fea20472-de34-4441-9f41-887a012e79ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Request method failure captured: Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b HTTP/1.1 Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmT-a9KYb466OD5Drv3Xz81qZyGQfXkbOB6dEp6k723KOUCx26OY7I-Uf1faS7dYmQ0QJhOLKeYvP_LQ2isazwrorVarlgJCG3lZ3XKvf8uWsndZrl9kdWhNBejxIoqjEkYfxmZxCfSO2IVsERdDLdkIV3PCifqVzvgcWT1JLc6EnfM Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 151e9d2b290047e8acd9468c721b9dd3 Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1512152156 Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:55:33.244522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:55:33.247189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/151e9d2b290047e8acd9468c721b9dd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/151e9d2b290047e8acd9468c721b9dd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_151e9d2b290047e8acd9468c721b9dd3", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/151e9d2b290047e8acd9468c721b9dd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:55:33.247189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1512152156 Aug 24 17:55:33.247189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 151e9d2b290047e8acd9468c721b9dd3 Aug 24 17:55:33.247189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1512152156 Aug 24 17:55:33.247189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-ServerRescueNegativeTestJSON-1512152156-project Aug 24 17:55:33.247189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:55:33.247189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:55:33.247189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: 63ff0ea67ee64e14aafc5c51cad9684f Aug 24 17:55:33.247189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1512152156-project Aug 24 17:55:33.247189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:55:33.247189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance e1deb7e5-c813-4c8b-829e-3c38e10fde3b could not be found. Aug 24 17:55:33.247189 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': 'e1deb7e5-c813-4c8b-829e-3c38e10fde3b'} Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1deb7e5-c813-4c8b-829e-3c38e10fde3b could not be found. Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:33.248087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:33.249744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:33.249744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:55:33.249744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:55:33.249744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:55:33.249744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:55:33.249744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:55:33.249744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:55:33.249744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1deb7e5-c813-4c8b-829e-3c38e10fde3b could not be found. Aug 24 17:55:33.249744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:55:33.249744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:33.249744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:55:33.249744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:33.249744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:33.249744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:33.249744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:55:33.249744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:55:33.249744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1deb7e5-c813-4c8b-829e-3c38e10fde3b could not be found. Aug 24 17:55:33.249744 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:55:33.251643 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-fea20472-de34-4441-9f41-887a012e79ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Returning 404 to user: Instance e1deb7e5-c813-4c8b-829e-3c38e10fde3b could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:33.253402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-fea20472-de34-4441-9f41-887a012e79ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b" status: 404 len: 111 microversion: 2.1 time: 0.067297 Aug 24 17:55:33.254776 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 468/922] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:33 2022] GET /compute/v2.1/servers/e1deb7e5-c813-4c8b-829e-3c38e10fde3b => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:55:33.271242 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1c431c21-45c8-4751-b66b-5bd5d43d70cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:33.272259 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1c431c21-45c8-4751-b66b-5bd5d43d70cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:33.280869 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1c431c21-45c8-4751-b66b-5bd5d43d70cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:33.281765 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1c431c21-45c8-4751-b66b-5bd5d43d70cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:33.282638 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1c431c21-45c8-4751-b66b-5bd5d43d70cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:33.283530 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1c431c21-45c8-4751-b66b-5bd5d43d70cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:33.284142 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1c431c21-45c8-4751-b66b-5bd5d43d70cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:33.284776 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1c431c21-45c8-4751-b66b-5bd5d43d70cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:33.317298 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-04e18c02-220a-410d-9ee8-489ee582eb4c tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.476593 Aug 24 17:55:33.321796 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1c431c21-45c8-4751-b66b-5bd5d43d70cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Going to try to terminate instance {{(pid=127677) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:55:33.326640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 455/923] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 17:55:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:55:33.333083 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-9087d7f5-de51-4ef2-a240-995412384002 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:33.333821 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-9087d7f5-de51-4ef2-a240-995412384002 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:33.411703 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-9087d7f5-de51-4ef2-a240-995412384002 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:33.420933 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-9087d7f5-de51-4ef2-a240-995412384002 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1095 microversion: 2.1 time: 0.092894 Aug 24 17:55:33.423436 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 456/924] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:33 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1095 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:33.605477 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e9f5656b-9d30-45ef-8093-79952a9e61e7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:33.607037 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e9f5656b-9d30-45ef-8093-79952a9e61e7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:33.613953 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e9f5656b-9d30-45ef-8093-79952a9e61e7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:33.614607 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e9f5656b-9d30-45ef-8093-79952a9e61e7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:33.615039 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e9f5656b-9d30-45ef-8093-79952a9e61e7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:33.616076 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e9f5656b-9d30-45ef-8093-79952a9e61e7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:33.616657 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e9f5656b-9d30-45ef-8093-79952a9e61e7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:33.617068 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e9f5656b-9d30-45ef-8093-79952a9e61e7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:33.621668 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=6,nova_cell1:UPDATE=10 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:33.794888 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1c431c21-45c8-4751-b66b-5bd5d43d70cb tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "DELETE /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 204 len: 0 microversion: 2.1 time: 0.535498 Aug 24 17:55:33.795714 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 469/925] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:55:33 2022] DELETE /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:55:33.804714 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a31aabd0-2c5e-410b-82ec-eb82e5b38f81 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:33.805759 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a31aabd0-2c5e-410b-82ec-eb82e5b38f81 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:33.812921 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e9f5656b-9d30-45ef-8093-79952a9e61e7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:33.813496 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a31aabd0-2c5e-410b-82ec-eb82e5b38f81 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:33.814059 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a31aabd0-2c5e-410b-82ec-eb82e5b38f81 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:33.814500 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a31aabd0-2c5e-410b-82ec-eb82e5b38f81 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:33.815359 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a31aabd0-2c5e-410b-82ec-eb82e5b38f81 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:33.816474 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a31aabd0-2c5e-410b-82ec-eb82e5b38f81 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:33.816474 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a31aabd0-2c5e-410b-82ec-eb82e5b38f81 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:33.821699 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e9f5656b-9d30-45ef-8093-79952a9e61e7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:33.823796 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e9f5656b-9d30-45ef-8093-79952a9e61e7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:33.825038 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e9f5656b-9d30-45ef-8093-79952a9e61e7 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1730 microversion: 2.20 time: 0.224239 Aug 24 17:55:33.825600 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 457/926] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:33 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1730 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:34.002590 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a31aabd0-2c5e-410b-82ec-eb82e5b38f81 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:34.011672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a31aabd0-2c5e-410b-82ec-eb82e5b38f81 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.211394 Aug 24 17:55:34.012509 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 470/927] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:33 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:34.450831 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d1c29a3b-8df2-41a4-957a-e1fa19457c6a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:34.451451 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d1c29a3b-8df2-41a4-957a-e1fa19457c6a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:34.458306 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d1c29a3b-8df2-41a4-957a-e1fa19457c6a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:34.458774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d1c29a3b-8df2-41a4-957a-e1fa19457c6a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:34.459277 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d1c29a3b-8df2-41a4-957a-e1fa19457c6a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:34.459983 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d1c29a3b-8df2-41a4-957a-e1fa19457c6a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:34.460800 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d1c29a3b-8df2-41a4-957a-e1fa19457c6a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:34.461042 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d1c29a3b-8df2-41a4-957a-e1fa19457c6a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:34.559829 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d1c29a3b-8df2-41a4-957a-e1fa19457c6a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:34.572068 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d1c29a3b-8df2-41a4-957a-e1fa19457c6a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1145 microversion: 2.1 time: 0.126267 Aug 24 17:55:34.573520 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 458/928] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:34 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1145 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:34.850238 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e0a2a34c-e0ac-4d96-802a-ee156d5bd86b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:34.850843 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-e0a2a34c-e0ac-4d96-802a-ee156d5bd86b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:34.860049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e0a2a34c-e0ac-4d96-802a-ee156d5bd86b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:34.860875 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e0a2a34c-e0ac-4d96-802a-ee156d5bd86b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:34.861644 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e0a2a34c-e0ac-4d96-802a-ee156d5bd86b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:34.863007 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e0a2a34c-e0ac-4d96-802a-ee156d5bd86b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:34.863584 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e0a2a34c-e0ac-4d96-802a-ee156d5bd86b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:34.864171 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e0a2a34c-e0ac-4d96-802a-ee156d5bd86b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:35.017416 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e0a2a34c-e0ac-4d96-802a-ee156d5bd86b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:35.027031 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e0a2a34c-e0ac-4d96-802a-ee156d5bd86b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:35.029188 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e0a2a34c-e0ac-4d96-802a-ee156d5bd86b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:35.030409 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-e0a2a34c-e0ac-4d96-802a-ee156d5bd86b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1730 microversion: 2.20 time: 0.184016 Aug 24 17:55:35.043975 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 471/929] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:34 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:55:35.048924 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-285dcd94-562c-4536-86f1-bd4b1e760235 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:35.049579 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-285dcd94-562c-4536-86f1-bd4b1e760235 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:35.056504 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-285dcd94-562c-4536-86f1-bd4b1e760235 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:35.057027 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-285dcd94-562c-4536-86f1-bd4b1e760235 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:35.058110 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-285dcd94-562c-4536-86f1-bd4b1e760235 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:35.058821 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-285dcd94-562c-4536-86f1-bd4b1e760235 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:35.059281 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-285dcd94-562c-4536-86f1-bd4b1e760235 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:35.059709 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-285dcd94-562c-4536-86f1-bd4b1e760235 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:35.213142 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-285dcd94-562c-4536-86f1-bd4b1e760235 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:35.227435 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-285dcd94-562c-4536-86f1-bd4b1e760235 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.196677 Aug 24 17:55:35.228122 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 459/930] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:35 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:35.597577 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f919818f-f0a5-4501-a433-bf6791e3d069 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:35.598851 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-f919818f-f0a5-4501-a433-bf6791e3d069 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:35.611292 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f919818f-f0a5-4501-a433-bf6791e3d069 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:35.611783 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f919818f-f0a5-4501-a433-bf6791e3d069 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:35.612218 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f919818f-f0a5-4501-a433-bf6791e3d069 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:35.612918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f919818f-f0a5-4501-a433-bf6791e3d069 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:35.613388 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f919818f-f0a5-4501-a433-bf6791e3d069 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:35.613814 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f919818f-f0a5-4501-a433-bf6791e3d069 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:35.686791 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f919818f-f0a5-4501-a433-bf6791e3d069 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:35.696950 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-f919818f-f0a5-4501-a433-bf6791e3d069 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1145 microversion: 2.1 time: 0.105156 Aug 24 17:55:35.698451 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 472/931] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:35 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1145 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:36.054027 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d1d0e4ec-9fe6-4cb8-95fd-17ef940bcba0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:36.054626 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d1d0e4ec-9fe6-4cb8-95fd-17ef940bcba0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:36.061511 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d1d0e4ec-9fe6-4cb8-95fd-17ef940bcba0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:36.062350 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d1d0e4ec-9fe6-4cb8-95fd-17ef940bcba0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:36.062787 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d1d0e4ec-9fe6-4cb8-95fd-17ef940bcba0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:36.063515 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d1d0e4ec-9fe6-4cb8-95fd-17ef940bcba0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:36.063969 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d1d0e4ec-9fe6-4cb8-95fd-17ef940bcba0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:36.064593 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d1d0e4ec-9fe6-4cb8-95fd-17ef940bcba0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:36.228092 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d1d0e4ec-9fe6-4cb8-95fd-17ef940bcba0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:36.238287 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d1d0e4ec-9fe6-4cb8-95fd-17ef940bcba0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:36.239798 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d1d0e4ec-9fe6-4cb8-95fd-17ef940bcba0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:36.240976 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d1d0e4ec-9fe6-4cb8-95fd-17ef940bcba0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1730 microversion: 2.20 time: 0.191078 Aug 24 17:55:36.241582 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 460/932] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:36 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:36.267273 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-2372c395-e96c-4ecd-849e-e8757851189d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:36.268768 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-2372c395-e96c-4ecd-849e-e8757851189d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:36.276790 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2372c395-e96c-4ecd-849e-e8757851189d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:36.277707 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2372c395-e96c-4ecd-849e-e8757851189d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:36.278433 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2372c395-e96c-4ecd-849e-e8757851189d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:36.279109 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2372c395-e96c-4ecd-849e-e8757851189d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:36.279567 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2372c395-e96c-4ecd-849e-e8757851189d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:36.279994 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2372c395-e96c-4ecd-849e-e8757851189d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:36.442963 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-2372c395-e96c-4ecd-849e-e8757851189d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:36.452755 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-2372c395-e96c-4ecd-849e-e8757851189d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.189412 Aug 24 17:55:36.453407 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 473/933] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:36 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:36.733936 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-1c2b3a0e-8fdb-4482-8ee2-40c423075898 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:36.734558 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-1c2b3a0e-8fdb-4482-8ee2-40c423075898 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:36.740959 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c2b3a0e-8fdb-4482-8ee2-40c423075898 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:36.741452 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c2b3a0e-8fdb-4482-8ee2-40c423075898 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:36.741937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c2b3a0e-8fdb-4482-8ee2-40c423075898 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:36.742661 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c2b3a0e-8fdb-4482-8ee2-40c423075898 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:36.743121 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c2b3a0e-8fdb-4482-8ee2-40c423075898 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:36.743550 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1c2b3a0e-8fdb-4482-8ee2-40c423075898 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:36.825556 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-1c2b3a0e-8fdb-4482-8ee2-40c423075898 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:36.834296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-1c2b3a0e-8fdb-4482-8ee2-40c423075898 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1145 microversion: 2.1 time: 0.103955 Aug 24 17:55:36.837953 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 461/934] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:36 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1145 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:37.265521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a908342f-923d-4740-b0fd-45cc1a249f9f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:37.266174 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a908342f-923d-4740-b0fd-45cc1a249f9f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:37.274284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a908342f-923d-4740-b0fd-45cc1a249f9f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:37.274983 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a908342f-923d-4740-b0fd-45cc1a249f9f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:37.275201 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a908342f-923d-4740-b0fd-45cc1a249f9f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:37.276019 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a908342f-923d-4740-b0fd-45cc1a249f9f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:37.276911 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a908342f-923d-4740-b0fd-45cc1a249f9f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:37.277344 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a908342f-923d-4740-b0fd-45cc1a249f9f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:37.428941 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a908342f-923d-4740-b0fd-45cc1a249f9f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:37.433976 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:37.440068 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a908342f-923d-4740-b0fd-45cc1a249f9f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:37.441699 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a908342f-923d-4740-b0fd-45cc1a249f9f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:37.443024 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a908342f-923d-4740-b0fd-45cc1a249f9f tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1730 microversion: 2.20 time: 0.181379 Aug 24 17:55:37.443766 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 474/935] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:37 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:37.476452 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-669d89ec-2419-44aa-95d5-df79ecf5f5b3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:37.477138 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-669d89ec-2419-44aa-95d5-df79ecf5f5b3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:37.484007 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-669d89ec-2419-44aa-95d5-df79ecf5f5b3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:37.485306 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-669d89ec-2419-44aa-95d5-df79ecf5f5b3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:37.485747 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-669d89ec-2419-44aa-95d5-df79ecf5f5b3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:37.486530 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-669d89ec-2419-44aa-95d5-df79ecf5f5b3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:37.486985 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-669d89ec-2419-44aa-95d5-df79ecf5f5b3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:37.487406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-669d89ec-2419-44aa-95d5-df79ecf5f5b3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:37.656137 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-669d89ec-2419-44aa-95d5-df79ecf5f5b3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:37.670066 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-669d89ec-2419-44aa-95d5-df79ecf5f5b3 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.193322 Aug 24 17:55:37.670066 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 462/936] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:37 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:37.858973 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-bfacd725-23e3-421e-9947-7094979b3562 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:37.859742 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-bfacd725-23e3-421e-9947-7094979b3562 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:37.868102 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bfacd725-23e3-421e-9947-7094979b3562 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:37.869195 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bfacd725-23e3-421e-9947-7094979b3562 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:37.870533 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bfacd725-23e3-421e-9947-7094979b3562 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:37.872565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bfacd725-23e3-421e-9947-7094979b3562 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:37.872565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bfacd725-23e3-421e-9947-7094979b3562 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:37.872565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bfacd725-23e3-421e-9947-7094979b3562 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:37.970255 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-bfacd725-23e3-421e-9947-7094979b3562 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:37.977421 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-bfacd725-23e3-421e-9947-7094979b3562 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1145 microversion: 2.1 time: 0.124416 Aug 24 17:55:37.981888 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 475/937] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:37 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1145 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:38.478376 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-df7b3366-b7b0-4593-a0b4-e6bf4948a6f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:38.481580 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-df7b3366-b7b0-4593-a0b4-e6bf4948a6f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:38.486089 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:38.490112 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-df7b3366-b7b0-4593-a0b4-e6bf4948a6f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:38.490873 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-df7b3366-b7b0-4593-a0b4-e6bf4948a6f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:38.491674 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-df7b3366-b7b0-4593-a0b4-e6bf4948a6f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:38.492731 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-df7b3366-b7b0-4593-a0b4-e6bf4948a6f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:38.493194 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-df7b3366-b7b0-4593-a0b4-e6bf4948a6f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:38.493785 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-df7b3366-b7b0-4593-a0b4-e6bf4948a6f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:38.655815 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-df7b3366-b7b0-4593-a0b4-e6bf4948a6f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:38.665393 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-df7b3366-b7b0-4593-a0b4-e6bf4948a6f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:38.667672 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-df7b3366-b7b0-4593-a0b4-e6bf4948a6f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:38.668944 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-df7b3366-b7b0-4593-a0b4-e6bf4948a6f5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1730 microversion: 2.20 time: 0.196456 Aug 24 17:55:38.669501 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 463/938] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:38 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:38.688257 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-49182231-efed-4132-b25f-c6abf51b409b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:38.689154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-49182231-efed-4132-b25f-c6abf51b409b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:38.696086 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-49182231-efed-4132-b25f-c6abf51b409b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:38.696580 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-49182231-efed-4132-b25f-c6abf51b409b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:38.697018 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-49182231-efed-4132-b25f-c6abf51b409b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:38.697770 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-49182231-efed-4132-b25f-c6abf51b409b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:38.698274 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-49182231-efed-4132-b25f-c6abf51b409b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:38.698700 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-49182231-efed-4132-b25f-c6abf51b409b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:38.898453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-49182231-efed-4132-b25f-c6abf51b409b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:38.917434 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-49182231-efed-4132-b25f-c6abf51b409b tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.231499 Aug 24 17:55:38.921525 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 476/939] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:38 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:39.006858 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-15360472-45df-46e0-9dc0-0a863cee3679 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:39.006858 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-15360472-45df-46e0-9dc0-0a863cee3679 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:39.009205 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-15360472-45df-46e0-9dc0-0a863cee3679 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:39.009693 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-15360472-45df-46e0-9dc0-0a863cee3679 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:39.010281 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-15360472-45df-46e0-9dc0-0a863cee3679 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:39.011011 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-15360472-45df-46e0-9dc0-0a863cee3679 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:39.011468 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-15360472-45df-46e0-9dc0-0a863cee3679 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:39.011895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-15360472-45df-46e0-9dc0-0a863cee3679 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:39.090641 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-15360472-45df-46e0-9dc0-0a863cee3679 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:39.098888 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-15360472-45df-46e0-9dc0-0a863cee3679 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1145 microversion: 2.1 time: 0.102512 Aug 24 17:55:39.099529 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 464/940] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:38 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1145 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:39.698187 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-134abb0f-1bbf-4bc1-9ad7-2612e441f76d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:39.698187 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-134abb0f-1bbf-4bc1-9ad7-2612e441f76d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:39.700900 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-134abb0f-1bbf-4bc1-9ad7-2612e441f76d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:39.703485 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-134abb0f-1bbf-4bc1-9ad7-2612e441f76d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:39.703938 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-134abb0f-1bbf-4bc1-9ad7-2612e441f76d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:39.704693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-134abb0f-1bbf-4bc1-9ad7-2612e441f76d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:39.705155 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-134abb0f-1bbf-4bc1-9ad7-2612e441f76d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:39.705580 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-134abb0f-1bbf-4bc1-9ad7-2612e441f76d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:39.880932 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-134abb0f-1bbf-4bc1-9ad7-2612e441f76d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:39.891514 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-134abb0f-1bbf-4bc1-9ad7-2612e441f76d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:39.893417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-134abb0f-1bbf-4bc1-9ad7-2612e441f76d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:39.895040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-134abb0f-1bbf-4bc1-9ad7-2612e441f76d tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1730 microversion: 2.20 time: 0.206266 Aug 24 17:55:39.900860 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 477/941] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:39 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:39.954568 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d6c5257b-c2b6-438e-adb5-ce1e55034034 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:39.955522 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d6c5257b-c2b6-438e-adb5-ce1e55034034 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:39.964079 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d6c5257b-c2b6-438e-adb5-ce1e55034034 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:39.964569 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d6c5257b-c2b6-438e-adb5-ce1e55034034 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:39.965014 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d6c5257b-c2b6-438e-adb5-ce1e55034034 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:39.965769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d6c5257b-c2b6-438e-adb5-ce1e55034034 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:39.966259 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d6c5257b-c2b6-438e-adb5-ce1e55034034 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:39.966683 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d6c5257b-c2b6-438e-adb5-ce1e55034034 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:40.122063 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c6d09503-da7b-40b0-8ac6-b125a7d99073 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:40.122784 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c6d09503-da7b-40b0-8ac6-b125a7d99073 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:40.125907 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=4 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:40.129469 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d6c5257b-c2b6-438e-adb5-ce1e55034034 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:40.131495 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c6d09503-da7b-40b0-8ac6-b125a7d99073 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:40.131989 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c6d09503-da7b-40b0-8ac6-b125a7d99073 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:40.132444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c6d09503-da7b-40b0-8ac6-b125a7d99073 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:40.133166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c6d09503-da7b-40b0-8ac6-b125a7d99073 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:40.134137 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c6d09503-da7b-40b0-8ac6-b125a7d99073 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:40.134137 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c6d09503-da7b-40b0-8ac6-b125a7d99073 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:40.146354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d6c5257b-c2b6-438e-adb5-ce1e55034034 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.196081 Aug 24 17:55:40.148510 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 465/942] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:39 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:40.213731 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c6d09503-da7b-40b0-8ac6-b125a7d99073 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:40.226646 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c6d09503-da7b-40b0-8ac6-b125a7d99073 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1145 microversion: 2.1 time: 0.109747 Aug 24 17:55:40.235258 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 478/943] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:40 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1145 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:40.925877 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-05a2bf9d-abf5-49a3-8898-c4e0f8cf7799 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:40.926832 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-05a2bf9d-abf5-49a3-8898-c4e0f8cf7799 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:40.935539 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-05a2bf9d-abf5-49a3-8898-c4e0f8cf7799 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:40.936038 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-05a2bf9d-abf5-49a3-8898-c4e0f8cf7799 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:40.936477 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-05a2bf9d-abf5-49a3-8898-c4e0f8cf7799 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:40.937206 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-05a2bf9d-abf5-49a3-8898-c4e0f8cf7799 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:40.937668 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-05a2bf9d-abf5-49a3-8898-c4e0f8cf7799 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:40.938301 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-05a2bf9d-abf5-49a3-8898-c4e0f8cf7799 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:41.092399 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-05a2bf9d-abf5-49a3-8898-c4e0f8cf7799 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:41.105688 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-05a2bf9d-abf5-49a3-8898-c4e0f8cf7799 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:41.107622 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-05a2bf9d-abf5-49a3-8898-c4e0f8cf7799 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:41.109026 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-05a2bf9d-abf5-49a3-8898-c4e0f8cf7799 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1730 microversion: 2.20 time: 0.187409 Aug 24 17:55:41.113050 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 466/944] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:40 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:41.170238 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-8e20d421-3c39-47c3-ae83-aec78d6e80de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:41.171154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-8e20d421-3c39-47c3-ae83-aec78d6e80de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:41.177574 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8e20d421-3c39-47c3-ae83-aec78d6e80de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:41.178102 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8e20d421-3c39-47c3-ae83-aec78d6e80de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:41.178540 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8e20d421-3c39-47c3-ae83-aec78d6e80de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:41.179241 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8e20d421-3c39-47c3-ae83-aec78d6e80de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:41.179696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8e20d421-3c39-47c3-ae83-aec78d6e80de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:41.180122 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8e20d421-3c39-47c3-ae83-aec78d6e80de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:41.249651 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a5ea0523-4571-4fb0-86c4-d0badf2a1e23 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:41.249937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a5ea0523-4571-4fb0-86c4-d0badf2a1e23 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:41.257306 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a5ea0523-4571-4fb0-86c4-d0badf2a1e23 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:41.262035 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a5ea0523-4571-4fb0-86c4-d0badf2a1e23 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:41.262035 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a5ea0523-4571-4fb0-86c4-d0badf2a1e23 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:41.262035 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a5ea0523-4571-4fb0-86c4-d0badf2a1e23 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:41.262035 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a5ea0523-4571-4fb0-86c4-d0badf2a1e23 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:41.262544 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a5ea0523-4571-4fb0-86c4-d0badf2a1e23 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:41.370522 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a5ea0523-4571-4fb0-86c4-d0badf2a1e23 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:41.380595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a5ea0523-4571-4fb0-86c4-d0badf2a1e23 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1145 microversion: 2.1 time: 0.136388 Aug 24 17:55:41.381190 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 467/945] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:41 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1145 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:41.403011 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-8e20d421-3c39-47c3-ae83-aec78d6e80de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:41.411343 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-8e20d421-3c39-47c3-ae83-aec78d6e80de tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.246234 Aug 24 17:55:41.411949 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 479/946] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:41 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:42.136388 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8b6f38a3-4b31-44f2-ae72-2fc50d44e5bb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:42.142920 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8b6f38a3-4b31-44f2-ae72-2fc50d44e5bb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:42.149640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8b6f38a3-4b31-44f2-ae72-2fc50d44e5bb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:42.150272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8b6f38a3-4b31-44f2-ae72-2fc50d44e5bb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:42.150803 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8b6f38a3-4b31-44f2-ae72-2fc50d44e5bb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:42.151894 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8b6f38a3-4b31-44f2-ae72-2fc50d44e5bb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:42.152430 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8b6f38a3-4b31-44f2-ae72-2fc50d44e5bb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:42.152892 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8b6f38a3-4b31-44f2-ae72-2fc50d44e5bb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:42.402268 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e0bddc7a-2069-4e5d-92f2-a98acea61426 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:42.403152 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-e0bddc7a-2069-4e5d-92f2-a98acea61426 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:42.411349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e0bddc7a-2069-4e5d-92f2-a98acea61426 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:42.411840 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e0bddc7a-2069-4e5d-92f2-a98acea61426 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:42.412278 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e0bddc7a-2069-4e5d-92f2-a98acea61426 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:42.412981 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e0bddc7a-2069-4e5d-92f2-a98acea61426 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:42.413441 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e0bddc7a-2069-4e5d-92f2-a98acea61426 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:42.413890 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e0bddc7a-2069-4e5d-92f2-a98acea61426 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:42.448773 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8b6f38a3-4b31-44f2-ae72-2fc50d44e5bb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:42.463141 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8b6f38a3-4b31-44f2-ae72-2fc50d44e5bb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:42.466186 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8b6f38a3-4b31-44f2-ae72-2fc50d44e5bb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:42.468414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-8b6f38a3-4b31-44f2-ae72-2fc50d44e5bb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1730 microversion: 2.20 time: 0.339142 Aug 24 17:55:42.469372 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 468/947] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:42 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1730 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:42.478551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-c6ddda9b-558e-4be7-a56f-91d68f23e9f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:42.479776 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-c6ddda9b-558e-4be7-a56f-91d68f23e9f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:42.491251 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c6ddda9b-558e-4be7-a56f-91d68f23e9f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:42.492157 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c6ddda9b-558e-4be7-a56f-91d68f23e9f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:42.492993 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c6ddda9b-558e-4be7-a56f-91d68f23e9f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:42.494953 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c6ddda9b-558e-4be7-a56f-91d68f23e9f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:42.495908 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c6ddda9b-558e-4be7-a56f-91d68f23e9f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:42.496710 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c6ddda9b-558e-4be7-a56f-91d68f23e9f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:42.498063 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e0bddc7a-2069-4e5d-92f2-a98acea61426 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:42.506469 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-e0bddc7a-2069-4e5d-92f2-a98acea61426 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1145 microversion: 2.1 time: 0.108016 Aug 24 17:55:42.507513 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 480/948] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:42 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1145 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:42.627486 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=2 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:42.642409 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c6ddda9b-558e-4be7-a56f-91d68f23e9f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:42.651152 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-c6ddda9b-558e-4be7-a56f-91d68f23e9f0 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.179846 Aug 24 17:55:42.651711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 469/949] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:42 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:43.510425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-baca1e8a-b148-4212-8f98-9f34d28e8f76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:43.511198 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-baca1e8a-b148-4212-8f98-9f34d28e8f76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:43.517697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-baca1e8a-b148-4212-8f98-9f34d28e8f76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:43.518479 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-baca1e8a-b148-4212-8f98-9f34d28e8f76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:43.518923 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-baca1e8a-b148-4212-8f98-9f34d28e8f76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:43.519626 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-baca1e8a-b148-4212-8f98-9f34d28e8f76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:43.520085 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-baca1e8a-b148-4212-8f98-9f34d28e8f76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:43.520515 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-baca1e8a-b148-4212-8f98-9f34d28e8f76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:43.529962 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-19805da1-126a-47ba-aad5-271eebdeb280 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:43.530590 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-19805da1-126a-47ba-aad5-271eebdeb280 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:43.533362 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=8 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:43.539015 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-19805da1-126a-47ba-aad5-271eebdeb280 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:43.539506 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-19805da1-126a-47ba-aad5-271eebdeb280 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:43.539948 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-19805da1-126a-47ba-aad5-271eebdeb280 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:43.540667 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-19805da1-126a-47ba-aad5-271eebdeb280 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:43.542333 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-19805da1-126a-47ba-aad5-271eebdeb280 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:43.542773 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-19805da1-126a-47ba-aad5-271eebdeb280 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:43.627143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-19805da1-126a-47ba-aad5-271eebdeb280 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:43.635253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-19805da1-126a-47ba-aad5-271eebdeb280 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1145 microversion: 2.1 time: 0.110329 Aug 24 17:55:43.637352 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 470/950] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:43 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1145 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:43.676713 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-fcb875e6-3766-4b27-b46d-b44aad0f22ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:43.677436 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-fcb875e6-3766-4b27-b46d-b44aad0f22ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:43.684354 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fcb875e6-3766-4b27-b46d-b44aad0f22ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:43.684784 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fcb875e6-3766-4b27-b46d-b44aad0f22ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:43.685228 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fcb875e6-3766-4b27-b46d-b44aad0f22ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:43.685989 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fcb875e6-3766-4b27-b46d-b44aad0f22ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:43.686452 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fcb875e6-3766-4b27-b46d-b44aad0f22ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:43.686885 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-fcb875e6-3766-4b27-b46d-b44aad0f22ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:43.693704 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-baca1e8a-b148-4212-8f98-9f34d28e8f76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:43.703343 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-baca1e8a-b148-4212-8f98-9f34d28e8f76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:43.705043 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-baca1e8a-b148-4212-8f98-9f34d28e8f76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:43.706374 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-baca1e8a-b148-4212-8f98-9f34d28e8f76 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1730 microversion: 2.20 time: 0.199986 Aug 24 17:55:43.707012 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 481/951] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:43 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:43.830133 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-fcb875e6-3766-4b27-b46d-b44aad0f22ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:43.838955 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-fcb875e6-3766-4b27-b46d-b44aad0f22ef tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.165464 Aug 24 17:55:43.839536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 471/952] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:43 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:44.656776 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-fd7046f5-69ca-4042-a272-4fe6a29a7529 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:44.657330 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-fd7046f5-69ca-4042-a272-4fe6a29a7529 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:44.663954 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fd7046f5-69ca-4042-a272-4fe6a29a7529 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:44.664445 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fd7046f5-69ca-4042-a272-4fe6a29a7529 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:44.664885 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fd7046f5-69ca-4042-a272-4fe6a29a7529 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:44.665590 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fd7046f5-69ca-4042-a272-4fe6a29a7529 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:44.666662 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fd7046f5-69ca-4042-a272-4fe6a29a7529 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:44.667099 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-fd7046f5-69ca-4042-a272-4fe6a29a7529 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:44.730836 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-fd7046f5-69ca-4042-a272-4fe6a29a7529 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:44.732498 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0fb3b923-492d-4901-9816-81cfc451c81e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:44.738858 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0fb3b923-492d-4901-9816-81cfc451c81e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:44.740985 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-fd7046f5-69ca-4042-a272-4fe6a29a7529 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1145 microversion: 2.1 time: 0.088046 Aug 24 17:55:44.741753 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 482/953] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:44 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:44.754217 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0fb3b923-492d-4901-9816-81cfc451c81e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:44.754818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0fb3b923-492d-4901-9816-81cfc451c81e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:44.755474 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0fb3b923-492d-4901-9816-81cfc451c81e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:44.756082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0fb3b923-492d-4901-9816-81cfc451c81e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:44.756646 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0fb3b923-492d-4901-9816-81cfc451c81e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:44.757159 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0fb3b923-492d-4901-9816-81cfc451c81e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:44.861560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-159af769-5294-4f5e-a3b3-392152c0df64 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:44.862230 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-159af769-5294-4f5e-a3b3-392152c0df64 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:44.870240 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-159af769-5294-4f5e-a3b3-392152c0df64 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:44.870912 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-159af769-5294-4f5e-a3b3-392152c0df64 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:44.871361 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-159af769-5294-4f5e-a3b3-392152c0df64 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:44.872087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-159af769-5294-4f5e-a3b3-392152c0df64 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:44.872726 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-159af769-5294-4f5e-a3b3-392152c0df64 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:44.873165 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-159af769-5294-4f5e-a3b3-392152c0df64 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:44.899372 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0fb3b923-492d-4901-9816-81cfc451c81e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:44.909247 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0fb3b923-492d-4901-9816-81cfc451c81e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:44.910957 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0fb3b923-492d-4901-9816-81cfc451c81e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:44.912106 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0fb3b923-492d-4901-9816-81cfc451c81e tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1730 microversion: 2.20 time: 0.186682 Aug 24 17:55:44.913883 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 472/954] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:44 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:55:45.290602 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-159af769-5294-4f5e-a3b3-392152c0df64 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:45.304193 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-159af769-5294-4f5e-a3b3-392152c0df64 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.446522 Aug 24 17:55:45.304815 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 483/955] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:44 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:45.767350 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ead814a6-867e-4ddd-9941-956fd7a10fe6 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:45.767931 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-ead814a6-867e-4ddd-9941-956fd7a10fe6 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:45.784885 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ead814a6-867e-4ddd-9941-956fd7a10fe6 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:45.786625 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ead814a6-867e-4ddd-9941-956fd7a10fe6 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:45.787111 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ead814a6-867e-4ddd-9941-956fd7a10fe6 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:45.788083 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ead814a6-867e-4ddd-9941-956fd7a10fe6 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:45.788632 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ead814a6-867e-4ddd-9941-956fd7a10fe6 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:45.789171 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ead814a6-867e-4ddd-9941-956fd7a10fe6 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:45.861433 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-ead814a6-867e-4ddd-9941-956fd7a10fe6 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:45.863747 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=100 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:45.871315 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-ead814a6-867e-4ddd-9941-956fd7a10fe6 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1145 microversion: 2.1 time: 0.112017 Aug 24 17:55:45.871908 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 473/956] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:45 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1145 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:45.937247 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0778a5bc-8876-40e8-8970-f201821a4b66 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:45.938086 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0778a5bc-8876-40e8-8970-f201821a4b66 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:45.948790 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0778a5bc-8876-40e8-8970-f201821a4b66 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:45.949530 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0778a5bc-8876-40e8-8970-f201821a4b66 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:45.950282 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0778a5bc-8876-40e8-8970-f201821a4b66 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:45.951413 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0778a5bc-8876-40e8-8970-f201821a4b66 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:45.952156 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0778a5bc-8876-40e8-8970-f201821a4b66 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:45.954781 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0778a5bc-8876-40e8-8970-f201821a4b66 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:46.110206 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0778a5bc-8876-40e8-8970-f201821a4b66 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:46.119165 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0778a5bc-8876-40e8-8970-f201821a4b66 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:46.120727 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0778a5bc-8876-40e8-8970-f201821a4b66 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:46.122181 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0778a5bc-8876-40e8-8970-f201821a4b66 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1730 microversion: 2.20 time: 0.188983 Aug 24 17:55:46.123354 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 484/957] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:45 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:46.328333 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-9ec2bb1e-25f1-4e35-9f36-f4652bb9a11d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:46.328866 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-9ec2bb1e-25f1-4e35-9f36-f4652bb9a11d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:46.335615 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9ec2bb1e-25f1-4e35-9f36-f4652bb9a11d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:46.336112 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9ec2bb1e-25f1-4e35-9f36-f4652bb9a11d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:46.336553 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9ec2bb1e-25f1-4e35-9f36-f4652bb9a11d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:46.337264 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9ec2bb1e-25f1-4e35-9f36-f4652bb9a11d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:46.337726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9ec2bb1e-25f1-4e35-9f36-f4652bb9a11d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:46.338769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9ec2bb1e-25f1-4e35-9f36-f4652bb9a11d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:46.486935 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-9ec2bb1e-25f1-4e35-9f36-f4652bb9a11d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:46.498242 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-9ec2bb1e-25f1-4e35-9f36-f4652bb9a11d tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1521 microversion: 2.1 time: 0.173621 Aug 24 17:55:46.499752 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 474/958] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:46 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:46.905591 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-28deee9f-f163-4ef4-8f50-1ef47c34ec16 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:46.906401 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-28deee9f-f163-4ef4-8f50-1ef47c34ec16 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:46.913487 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-28deee9f-f163-4ef4-8f50-1ef47c34ec16 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:46.914016 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-28deee9f-f163-4ef4-8f50-1ef47c34ec16 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:46.914450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-28deee9f-f163-4ef4-8f50-1ef47c34ec16 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:46.915237 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-28deee9f-f163-4ef4-8f50-1ef47c34ec16 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:46.915688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-28deee9f-f163-4ef4-8f50-1ef47c34ec16 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:46.916838 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-28deee9f-f163-4ef4-8f50-1ef47c34ec16 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:46.987804 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-28deee9f-f163-4ef4-8f50-1ef47c34ec16 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:47.001128 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-28deee9f-f163-4ef4-8f50-1ef47c34ec16 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1193 microversion: 2.1 time: 0.099812 Aug 24 17:55:47.002212 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 485/959] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:46 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1193 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:47.112301 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-0f64aaa0-8024-4bac-af05-1dfc056a143f req-13f2e9d3-0ddb-4e07-82ce-023d367d233d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec18342-3f45-401f-ba1a-768a427a5fa2", "name": "network-vif-deleted", "tag": "565c8009-6ae5-4c23-a533-fff7bf8e849d"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:47.123852 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-0f64aaa0-8024-4bac-af05-1dfc056a143f req-13f2e9d3-0ddb-4e07-82ce-023d367d233d service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:47.123852 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-0f64aaa0-8024-4bac-af05-1dfc056a143f req-13f2e9d3-0ddb-4e07-82ce-023d367d233d service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:47.123852 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-0f64aaa0-8024-4bac-af05-1dfc056a143f req-13f2e9d3-0ddb-4e07-82ce-023d367d233d service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:47.136780 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-0f64aaa0-8024-4bac-af05-1dfc056a143f req-13f2e9d3-0ddb-4e07-82ce-023d367d233d service nova] Creating event network-vif-deleted:565c8009-6ae5-4c23-a533-fff7bf8e849d for instance 4ec18342-3f45-401f-ba1a-768a427a5fa2 on hv-cinder-85442 Aug 24 17:55:47.142321 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-0f64aaa0-8024-4bac-af05-1dfc056a143f req-13f2e9d3-0ddb-4e07-82ce-023d367d233d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033586 Aug 24 17:55:47.143160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 475/960] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:47.147714 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9af048a5-563b-4e2d-843e-0cf0cb08a483 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:47.148349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9af048a5-563b-4e2d-843e-0cf0cb08a483 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:47.154862 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9af048a5-563b-4e2d-843e-0cf0cb08a483 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:47.155381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9af048a5-563b-4e2d-843e-0cf0cb08a483 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:47.155843 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9af048a5-563b-4e2d-843e-0cf0cb08a483 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:47.156494 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9af048a5-563b-4e2d-843e-0cf0cb08a483 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:47.157134 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9af048a5-563b-4e2d-843e-0cf0cb08a483 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:47.158008 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9af048a5-563b-4e2d-843e-0cf0cb08a483 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:47.311229 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9af048a5-563b-4e2d-843e-0cf0cb08a483 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:47.320057 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9af048a5-563b-4e2d-843e-0cf0cb08a483 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:47.321669 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9af048a5-563b-4e2d-843e-0cf0cb08a483 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:47.323781 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9af048a5-563b-4e2d-843e-0cf0cb08a483 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1730 microversion: 2.20 time: 0.180968 Aug 24 17:55:47.324407 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 486/961] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:47 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:55:47.423579 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f5673f3e-27e1-4c90-be35-3cd2cc1c9ecc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:47.427703 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f5673f3e-27e1-4c90-be35-3cd2cc1c9ecc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:47.448276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f5673f3e-27e1-4c90-be35-3cd2cc1c9ecc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:47.448864 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f5673f3e-27e1-4c90-be35-3cd2cc1c9ecc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:47.449296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f5673f3e-27e1-4c90-be35-3cd2cc1c9ecc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:47.450066 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f5673f3e-27e1-4c90-be35-3cd2cc1c9ecc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:47.450529 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f5673f3e-27e1-4c90-be35-3cd2cc1c9ecc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:47.451151 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f5673f3e-27e1-4c90-be35-3cd2cc1c9ecc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:47.486022 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f5673f3e-27e1-4c90-be35-3cd2cc1c9ecc tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067302 Aug 24 17:55:47.492038 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 476/962] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:55:47 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:47.498119 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-8b88cdec-e3cd-4dd8-95d6-13a01cbb40ed tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:47.498619 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-8b88cdec-e3cd-4dd8-95d6-13a01cbb40ed tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:47.505325 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8b88cdec-e3cd-4dd8-95d6-13a01cbb40ed tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:47.505815 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8b88cdec-e3cd-4dd8-95d6-13a01cbb40ed tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:47.506279 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8b88cdec-e3cd-4dd8-95d6-13a01cbb40ed tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:47.507064 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8b88cdec-e3cd-4dd8-95d6-13a01cbb40ed tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:47.507536 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8b88cdec-e3cd-4dd8-95d6-13a01cbb40ed tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:47.507951 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8b88cdec-e3cd-4dd8-95d6-13a01cbb40ed tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:47.521200 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-231700bb-0bbd-442e-bbac-8574db00c603 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:47.521811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-231700bb-0bbd-442e-bbac-8574db00c603 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:47.528182 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-231700bb-0bbd-442e-bbac-8574db00c603 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:47.528981 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-231700bb-0bbd-442e-bbac-8574db00c603 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:47.529646 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-231700bb-0bbd-442e-bbac-8574db00c603 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:47.531698 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-231700bb-0bbd-442e-bbac-8574db00c603 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:47.532391 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-231700bb-0bbd-442e-bbac-8574db00c603 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:47.534550 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-231700bb-0bbd-442e-bbac-8574db00c603 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:47.575182 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-231700bb-0bbd-442e-bbac-8574db00c603 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:47.575795 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-231700bb-0bbd-442e-bbac-8574db00c603 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:47.576382 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-231700bb-0bbd-442e-bbac-8574db00c603 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:47.576943 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-231700bb-0bbd-442e-bbac-8574db00c603 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lazy-loading 'fault' on Instance uuid 4ec18342-3f45-401f-ba1a-768a427a5fa2 {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:55:47.585485 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-8b88cdec-e3cd-4dd8-95d6-13a01cbb40ed tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments/b2bdcc61-a323-42b9-9488-c9fc92c74550" status: 200 len: 194 microversion: 2.1 time: 0.092011 Aug 24 17:55:47.586171 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 487/963] 10.222.0.76 () {58 vars in 1413 bytes} [Wed Aug 24 17:55:47 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments/b2bdcc61-a323-42b9-9488-c9fc92c74550 => generated 194 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:55:47.645467 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-231700bb-0bbd-442e-bbac-8574db00c603 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ff0ea67ee64e14aafc5c51cad9684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151e9d2b290047e8acd9468c721b9dd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:47.658839 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-231700bb-0bbd-442e-bbac-8574db00c603 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 200 len: 1311 microversion: 2.1 time: 0.140101 Aug 24 17:55:47.660956 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 477/964] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:47 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 1311 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:47.723665 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-865e3261-99f4-417d-bfee-600a64da5e50 req-077e90bb-6b8e-4b29-bbd1-44e8c3e6fb88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861f638b-1bdf-459e-bf10-2846d8994ac4", "name": "network-vif-plugged", "status": "completed", "tag": "83c659e2-8827-4402-9131-6edb2b9b0a44"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:47.737032 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-865e3261-99f4-417d-bfee-600a64da5e50 req-077e90bb-6b8e-4b29-bbd1-44e8c3e6fb88 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:47.737508 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-865e3261-99f4-417d-bfee-600a64da5e50 req-077e90bb-6b8e-4b29-bbd1-44e8c3e6fb88 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:47.737984 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-865e3261-99f4-417d-bfee-600a64da5e50 req-077e90bb-6b8e-4b29-bbd1-44e8c3e6fb88 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:47.753639 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-865e3261-99f4-417d-bfee-600a64da5e50 req-077e90bb-6b8e-4b29-bbd1-44e8c3e6fb88 service nova] Creating event network-vif-plugged:83c659e2-8827-4402-9131-6edb2b9b0a44 for instance 861f638b-1bdf-459e-bf10-2846d8994ac4 on hv-cinder-85442 Aug 24 17:55:47.768469 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-865e3261-99f4-417d-bfee-600a64da5e50 req-077e90bb-6b8e-4b29-bbd1-44e8c3e6fb88 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048733 Aug 24 17:55:47.769070 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 488/965] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:48.025006 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ffe57919-6787-438d-9df6-fb579e09e1e8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:48.025655 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-ffe57919-6787-438d-9df6-fb579e09e1e8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:48.032544 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ffe57919-6787-438d-9df6-fb579e09e1e8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:48.042555 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ffe57919-6787-438d-9df6-fb579e09e1e8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:48.042555 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ffe57919-6787-438d-9df6-fb579e09e1e8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:48.042555 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ffe57919-6787-438d-9df6-fb579e09e1e8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:48.042555 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ffe57919-6787-438d-9df6-fb579e09e1e8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:48.043012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ffe57919-6787-438d-9df6-fb579e09e1e8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:48.133065 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-ffe57919-6787-438d-9df6-fb579e09e1e8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:48.144023 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-ffe57919-6787-438d-9df6-fb579e09e1e8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1211 microversion: 2.1 time: 0.123175 Aug 24 17:55:48.145087 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 478/966] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:48 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1211 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:48.352883 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3dac39aa-2973-4a33-a314-f532564d4333 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:48.355168 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3dac39aa-2973-4a33-a314-f532564d4333 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:48.363988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3dac39aa-2973-4a33-a314-f532564d4333 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:48.364966 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3dac39aa-2973-4a33-a314-f532564d4333 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:48.370103 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3dac39aa-2973-4a33-a314-f532564d4333 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:48.370103 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3dac39aa-2973-4a33-a314-f532564d4333 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:48.370103 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3dac39aa-2973-4a33-a314-f532564d4333 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:48.370103 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3dac39aa-2973-4a33-a314-f532564d4333 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:48.538968 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3dac39aa-2973-4a33-a314-f532564d4333 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:48.548371 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3dac39aa-2973-4a33-a314-f532564d4333 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:48.550025 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3dac39aa-2973-4a33-a314-f532564d4333 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:48.551237 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3dac39aa-2973-4a33-a314-f532564d4333 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1730 microversion: 2.20 time: 0.203719 Aug 24 17:55:48.552010 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 489/967] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:48 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:48.687351 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7cc8c77b-f781-4398-ae75-bb4b042c54d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:48.690289 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7cc8c77b-f781-4398-ae75-bb4b042c54d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] [instance: 4ec18342-3f45-401f-ba1a-768a427a5fa2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:48.696266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7cc8c77b-f781-4398-ae75-bb4b042c54d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:48.696936 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7cc8c77b-f781-4398-ae75-bb4b042c54d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:48.698081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7cc8c77b-f781-4398-ae75-bb4b042c54d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:48.699217 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7cc8c77b-f781-4398-ae75-bb4b042c54d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:48.699691 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7cc8c77b-f781-4398-ae75-bb4b042c54d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:48.700505 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7cc8c77b-f781-4398-ae75-bb4b042c54d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:48.716819 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-7cc8c77b-f781-4398-ae75-bb4b042c54d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] HTTP exception thrown: Instance 4ec18342-3f45-401f-ba1a-768a427a5fa2 could not be found. Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7cc8c77b-f781-4398-ae75-bb4b042c54d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Request method failure captured: Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 HTTP/1.1 Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmT-a9KYb466OD5Drv3Xz81qZyGQfXkbOB6dEp6k723KOUCx26OY7I-Uf1faS7dYmQ0QJhOLKeYvP_LQ2isazwrorVarlgJCG3lZ3XKvf8uWsndZrl9kdWhNBejxIoqjEkYfxmZxCfSO2IVsERdDLdkIV3PCifqVzvgcWT1JLc6EnfM Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 151e9d2b290047e8acd9468c721b9dd3 Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1512152156 Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:55:48.719175 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:55:48.720817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/151e9d2b290047e8acd9468c721b9dd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/151e9d2b290047e8acd9468c721b9dd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_151e9d2b290047e8acd9468c721b9dd3", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/151e9d2b290047e8acd9468c721b9dd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:55:48.720817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1512152156 Aug 24 17:55:48.720817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 151e9d2b290047e8acd9468c721b9dd3 Aug 24 17:55:48.720817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1512152156 Aug 24 17:55:48.720817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-ServerRescueNegativeTestJSON-1512152156-project Aug 24 17:55:48.720817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:55:48.720817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:55:48.720817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 63ff0ea67ee64e14aafc5c51cad9684f Aug 24 17:55:48.720817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1512152156-project Aug 24 17:55:48.720817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:55:48.720817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance 4ec18342-3f45-401f-ba1a-768a427a5fa2 could not be found. Aug 24 17:55:48.720817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': '4ec18342-3f45-401f-ba1a-768a427a5fa2'} Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ec18342-3f45-401f-ba1a-768a427a5fa2 could not be found. Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:48.721616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:48.725744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:48.725744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:55:48.725744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:55:48.725744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:55:48.725744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:55:48.725744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:55:48.725744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:55:48.725744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec18342-3f45-401f-ba1a-768a427a5fa2 could not be found. Aug 24 17:55:48.725744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:48.725744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:48.725744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:48.725744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:48.725744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:48.725744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:48.725744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:55:48.725744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:55:48.725744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec18342-3f45-401f-ba1a-768a427a5fa2 could not be found. Aug 24 17:55:48.725744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:48.726939 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7cc8c77b-f781-4398-ae75-bb4b042c54d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] Returning 404 to user: Instance 4ec18342-3f45-401f-ba1a-768a427a5fa2 could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:48.726939 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7cc8c77b-f781-4398-ae75-bb4b042c54d7 tempest-ServerRescueNegativeTestJSON-1512152156 tempest-ServerRescueNegativeTestJSON-1512152156-project] 10.222.0.76 "GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2" status: 404 len: 111 microversion: 2.1 time: 0.039666 Aug 24 17:55:48.726939 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 479/968] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:48 2022] GET /compute/v2.1/servers/4ec18342-3f45-401f-ba1a-768a427a5fa2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:55:49.167270 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-54cf1be3-8733-4c5a-bd5b-2801ce00393e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:49.168558 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-54cf1be3-8733-4c5a-bd5b-2801ce00393e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:49.175407 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-54cf1be3-8733-4c5a-bd5b-2801ce00393e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:49.176528 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-54cf1be3-8733-4c5a-bd5b-2801ce00393e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:49.177205 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-54cf1be3-8733-4c5a-bd5b-2801ce00393e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:49.178231 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-54cf1be3-8733-4c5a-bd5b-2801ce00393e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:49.178903 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-54cf1be3-8733-4c5a-bd5b-2801ce00393e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:49.179748 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-54cf1be3-8733-4c5a-bd5b-2801ce00393e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:49.440738 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-54cf1be3-8733-4c5a-bd5b-2801ce00393e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:49.449526 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-54cf1be3-8733-4c5a-bd5b-2801ce00393e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1279 microversion: 2.1 time: 0.286726 Aug 24 17:55:49.462115 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 490/969] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:49 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1279 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:49.497591 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e7aac506-e75c-4617-9a43-17c02a969e80 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be00e666-e2b8-4810-8470-af0b9c484097"}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:49.500027 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e7aac506-e75c-4617-9a43-17c02a969e80 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:49.506491 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e7aac506-e75c-4617-9a43-17c02a969e80 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:49.507055 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e7aac506-e75c-4617-9a43-17c02a969e80 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:49.507565 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e7aac506-e75c-4617-9a43-17c02a969e80 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:49.508353 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e7aac506-e75c-4617-9a43-17c02a969e80 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:49.509173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e7aac506-e75c-4617-9a43-17c02a969e80 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:49.509634 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e7aac506-e75c-4617-9a43-17c02a969e80 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:49.576528 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-81f61245-dc8c-486a-930c-0d5ac50f36a5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:49.577136 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-81f61245-dc8c-486a-930c-0d5ac50f36a5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:49.584119 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-81f61245-dc8c-486a-930c-0d5ac50f36a5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:49.584610 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-81f61245-dc8c-486a-930c-0d5ac50f36a5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:49.585046 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-81f61245-dc8c-486a-930c-0d5ac50f36a5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:49.585749 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-81f61245-dc8c-486a-930c-0d5ac50f36a5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:49.586285 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-81f61245-dc8c-486a-930c-0d5ac50f36a5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:49.586657 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-81f61245-dc8c-486a-930c-0d5ac50f36a5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:49.814257 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-81f61245-dc8c-486a-930c-0d5ac50f36a5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:49.823435 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-81f61245-dc8c-486a-930c-0d5ac50f36a5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:49.824957 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-81f61245-dc8c-486a-930c-0d5ac50f36a5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:49.826170 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-81f61245-dc8c-486a-930c-0d5ac50f36a5 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1730 microversion: 2.20 time: 0.254227 Aug 24 17:55:49.826732 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 491/970] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:49 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1730 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:55:49.961116 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-0e2c47d8-67db-4d8b-9f01-04148677c72c req-efd168f0-123f-49a3-a846-c2a4dbdf8a20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa9d4f71-3435-4fe1-94c1-3c2aa90852e0", "tag": "a5b4bf67-96d5-4f27-af69-f55896b0c827"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:49.974489 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-0e2c47d8-67db-4d8b-9f01-04148677c72c req-efd168f0-123f-49a3-a846-c2a4dbdf8a20 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:49.975029 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-0e2c47d8-67db-4d8b-9f01-04148677c72c req-efd168f0-123f-49a3-a846-c2a4dbdf8a20 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:49.975417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-0e2c47d8-67db-4d8b-9f01-04148677c72c req-efd168f0-123f-49a3-a846-c2a4dbdf8a20 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:49.983302 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=100 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:49.993051 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-0e2c47d8-67db-4d8b-9f01-04148677c72c req-efd168f0-123f-49a3-a846-c2a4dbdf8a20 service nova] Creating event network-changed:a5b4bf67-96d5-4f27-af69-f55896b0c827 for instance aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 on hv-cinder-85442 Aug 24 17:55:49.998837 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-0e2c47d8-67db-4d8b-9f01-04148677c72c req-efd168f0-123f-49a3-a846-c2a4dbdf8a20 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047883 Aug 24 17:55:49.999627 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 492/971] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:55:50.473561 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-16278efd-3fd4-40e0-bf5f-5e0ece0b3deb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:50.484289 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-16278efd-3fd4-40e0-bf5f-5e0ece0b3deb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:50.492293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-16278efd-3fd4-40e0-bf5f-5e0ece0b3deb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:50.492780 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-16278efd-3fd4-40e0-bf5f-5e0ece0b3deb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:50.493411 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-16278efd-3fd4-40e0-bf5f-5e0ece0b3deb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:50.495240 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-16278efd-3fd4-40e0-bf5f-5e0ece0b3deb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:50.496002 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-16278efd-3fd4-40e0-bf5f-5e0ece0b3deb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:50.496594 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-16278efd-3fd4-40e0-bf5f-5e0ece0b3deb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:50.756153 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-16278efd-3fd4-40e0-bf5f-5e0ece0b3deb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:50.768101 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-16278efd-3fd4-40e0-bf5f-5e0ece0b3deb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1267 microversion: 2.1 time: 0.299078 Aug 24 17:55:50.769124 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 493/972] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:50 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1267 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:50.848878 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9afaf602-f8f1-473f-a56a-ecf4aa6194f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:50.849530 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9afaf602-f8f1-473f-a56a-ecf4aa6194f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:50.861441 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9afaf602-f8f1-473f-a56a-ecf4aa6194f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:50.861960 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9afaf602-f8f1-473f-a56a-ecf4aa6194f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:50.862407 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9afaf602-f8f1-473f-a56a-ecf4aa6194f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:50.863177 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9afaf602-f8f1-473f-a56a-ecf4aa6194f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:50.863644 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9afaf602-f8f1-473f-a56a-ecf4aa6194f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:50.864079 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9afaf602-f8f1-473f-a56a-ecf4aa6194f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:50.930080 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e7aac506-e75c-4617-9a43-17c02a969e80 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "POST /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.436772 Aug 24 17:55:50.935444 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 480/973] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 17:55:49 2022] POST /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments => generated 194 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:51.059872 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9afaf602-f8f1-473f-a56a-ecf4aa6194f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:51.068518 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9afaf602-f8f1-473f-a56a-ecf4aa6194f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:51.070221 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9afaf602-f8f1-473f-a56a-ecf4aa6194f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:51.071643 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9afaf602-f8f1-473f-a56a-ecf4aa6194f9 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1730 microversion: 2.20 time: 0.226867 Aug 24 17:55:51.086210 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 494/974] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:50 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1730 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:55:51.803530 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-80acdcf5-3e3e-4709-96ce-cb07676e1e30 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:51.804391 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-80acdcf5-3e3e-4709-96ce-cb07676e1e30 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:51.811933 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-80acdcf5-3e3e-4709-96ce-cb07676e1e30 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:51.812373 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-80acdcf5-3e3e-4709-96ce-cb07676e1e30 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:51.812849 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-80acdcf5-3e3e-4709-96ce-cb07676e1e30 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:51.813572 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-80acdcf5-3e3e-4709-96ce-cb07676e1e30 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:51.814099 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-80acdcf5-3e3e-4709-96ce-cb07676e1e30 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:51.814537 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-80acdcf5-3e3e-4709-96ce-cb07676e1e30 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:52.032351 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-80acdcf5-3e3e-4709-96ce-cb07676e1e30 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:52.040768 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-80acdcf5-3e3e-4709-96ce-cb07676e1e30 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1267 microversion: 2.1 time: 0.241514 Aug 24 17:55:52.041751 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 481/975] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:51 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:52.097332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-233feb1d-b650-42e1-9749-5743b2d40d41 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:52.097983 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-233feb1d-b650-42e1-9749-5743b2d40d41 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:52.104787 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-233feb1d-b650-42e1-9749-5743b2d40d41 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:52.105309 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-233feb1d-b650-42e1-9749-5743b2d40d41 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:52.105755 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-233feb1d-b650-42e1-9749-5743b2d40d41 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:52.106501 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-233feb1d-b650-42e1-9749-5743b2d40d41 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:52.106964 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-233feb1d-b650-42e1-9749-5743b2d40d41 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:52.107395 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-233feb1d-b650-42e1-9749-5743b2d40d41 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:52.278094 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-233feb1d-b650-42e1-9749-5743b2d40d41 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:52.287060 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-233feb1d-b650-42e1-9749-5743b2d40d41 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:52.288592 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-233feb1d-b650-42e1-9749-5743b2d40d41 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:52.289785 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-233feb1d-b650-42e1-9749-5743b2d40d41 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1717 microversion: 2.20 time: 0.197871 Aug 24 17:55:52.290379 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 495/976] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:52 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1717 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:53.066483 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-4249db47-f07f-4c7e-8bfd-bdad7564aeaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:53.066483 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4249db47-f07f-4c7e-8bfd-bdad7564aeaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:53.070799 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4249db47-f07f-4c7e-8bfd-bdad7564aeaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:53.082196 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4249db47-f07f-4c7e-8bfd-bdad7564aeaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:53.082766 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4249db47-f07f-4c7e-8bfd-bdad7564aeaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:53.083935 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4249db47-f07f-4c7e-8bfd-bdad7564aeaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:53.084048 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4249db47-f07f-4c7e-8bfd-bdad7564aeaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:53.084421 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4249db47-f07f-4c7e-8bfd-bdad7564aeaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:53.235390 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-702e36f1-fe61-4a6d-9f16-94ca0a511c51 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:53.235938 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-702e36f1-fe61-4a6d-9f16-94ca0a511c51 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:53.242642 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-702e36f1-fe61-4a6d-9f16-94ca0a511c51 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:53.244473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-702e36f1-fe61-4a6d-9f16-94ca0a511c51 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:53.244473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-702e36f1-fe61-4a6d-9f16-94ca0a511c51 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:53.244934 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-702e36f1-fe61-4a6d-9f16-94ca0a511c51 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:53.245392 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-702e36f1-fe61-4a6d-9f16-94ca0a511c51 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:53.245810 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-702e36f1-fe61-4a6d-9f16-94ca0a511c51 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:53.247871 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-4249db47-f07f-4c7e-8bfd-bdad7564aeaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:53.255626 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-4249db47-f07f-4c7e-8bfd-bdad7564aeaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1267 microversion: 2.1 time: 0.197436 Aug 24 17:55:53.256189 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 482/977] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:53 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:53.271303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-702e36f1-fe61-4a6d-9f16-94ca0a511c51 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b/ips" status: 200 len: 149 microversion: 2.1 time: 0.040495 Aug 24 17:55:53.271908 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 496/978] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 24 17:55:53 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:55:54.277495 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-56a9072e-6f89-4305-8d4a-0de281be624e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:54.278897 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-56a9072e-6f89-4305-8d4a-0de281be624e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:54.285936 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-56a9072e-6f89-4305-8d4a-0de281be624e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:54.286484 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-56a9072e-6f89-4305-8d4a-0de281be624e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:54.286895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-56a9072e-6f89-4305-8d4a-0de281be624e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:54.287601 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-56a9072e-6f89-4305-8d4a-0de281be624e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:54.288116 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-56a9072e-6f89-4305-8d4a-0de281be624e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:54.288850 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-56a9072e-6f89-4305-8d4a-0de281be624e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:54.432151 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-56a9072e-6f89-4305-8d4a-0de281be624e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:54.441232 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-56a9072e-6f89-4305-8d4a-0de281be624e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1267 microversion: 2.1 time: 0.168177 Aug 24 17:55:54.441802 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 483/979] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:54 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:55.080354 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-80a11a13-3347-48e6-8585-160e88bb6b33 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "709d0a03-af8e-4c36-869c-5cf5cf36d246"}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:55.082812 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-80a11a13-3347-48e6-8585-160e88bb6b33 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:55.089828 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-80a11a13-3347-48e6-8585-160e88bb6b33 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:55.090354 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-80a11a13-3347-48e6-8585-160e88bb6b33 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:55.090987 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-80a11a13-3347-48e6-8585-160e88bb6b33 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:55.091703 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-80a11a13-3347-48e6-8585-160e88bb6b33 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:55.093499 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-80a11a13-3347-48e6-8585-160e88bb6b33 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:55.093499 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-80a11a13-3347-48e6-8585-160e88bb6b33 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:55.220413 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a923209b-e31f-4a58-8370-20332cbaa934 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] Action: 'create', calling method: .version_select at 0x7fce772fc3a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1944214352", "metadata": {"Type": "work"}}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a923209b-e31f-4a58-8370-20332cbaa934 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] Request method failure captured: Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 122 Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmYqGhftafPc1UjOFM15T1o2o2-i-jKU8-ZAo5hHn_T3ESTgEB15hyeGm1iDyHOdKQacoxhnAaliLTCQ38TRBmgra_n3PNMbcUKSZNMOz1MT1YGTDWcfiLN-p0U8_wyFMI-B_LT384mcSop40h6khAz8XFvULvTwjJ5Z3Gwp6-dUCuc Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: bbc74a757d3c4e29aa1d1448f659a706 Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-VolumesNegativeTest-2077208027 Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:55:55.239164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:55:55.240726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bbc74a757d3c4e29aa1d1448f659a706"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bbc74a757d3c4e29aa1d1448f659a706"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bbc74a757d3c4e29aa1d1448f659a706", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bbc74a757d3c4e29aa1d1448f659a706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:55:55.240726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-VolumesNegativeTest-2077208027 Aug 24 17:55:55.240726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: bbc74a757d3c4e29aa1d1448f659a706 Aug 24 17:55:55.240726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-VolumesNegativeTest-2077208027 Aug 24 17:55:55.240726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-VolumesNegativeTest-2077208027-project Aug 24 17:55:55.240726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:55:55.240726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:55:55.240726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 49a8558950d34fdba5ab39c70f472cad Aug 24 17:55:55.240726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-VolumesNegativeTest-2077208027-project Aug 24 17:55:55.240726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Aug 24 17:55:55.240726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1944214352", "metadata": {"Type": "work"}}} Aug 24 17:55:55.240726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: Aug 24 17:55:55.240726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1944214352', 'metadata': {'Type': 'work'}}}} Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise error Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:55.241755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:55.246968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:55:55.246968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:55:55.246968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:55.246968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:55.246968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 17:55:55.246968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 17:55:55.246968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 17:55:55.246968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 17:55:55.246968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 17:55:55.246968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 17:55:55.246968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 17:55:55.246968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.246968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:55.246968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.246968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.246968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:55.246968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:55.246968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 17:55:55.246968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 17:55:55.248515 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 17:55:55.248515 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.248515 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a923209b-e31f-4a58-8370-20332cbaa934 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:55.248515 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a923209b-e31f-4a58-8370-20332cbaa934 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.163656 Aug 24 17:55:55.248515 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 484/980] 10.222.0.76 () {60 vars in 1156 bytes} [Wed Aug 24 17:55:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 165 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 17:55:55.252660 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e312bc90-d601-4c5d-9083-455b895feb52 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] Action: 'create', calling method: .version_select at 0x7fce772a1f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-597489273", "metadata": {"Type": "work"}}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e312bc90-d601-4c5d-9083-455b895feb52 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] Request method failure captured: Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 119 Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmYqGhftafPc1UjOFM15T1o2o2-i-jKU8-ZAo5hHn_T3ESTgEB15hyeGm1iDyHOdKQacoxhnAaliLTCQ38TRBmgra_n3PNMbcUKSZNMOz1MT1YGTDWcfiLN-p0U8_wyFMI-B_LT384mcSop40h6khAz8XFvULvTwjJ5Z3Gwp6-dUCuc Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: bbc74a757d3c4e29aa1d1448f659a706 Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-VolumesNegativeTest-2077208027 Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:55:55.256519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:55:55.258085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bbc74a757d3c4e29aa1d1448f659a706"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bbc74a757d3c4e29aa1d1448f659a706"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bbc74a757d3c4e29aa1d1448f659a706", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bbc74a757d3c4e29aa1d1448f659a706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:55:55.258085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-VolumesNegativeTest-2077208027 Aug 24 17:55:55.258085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: bbc74a757d3c4e29aa1d1448f659a706 Aug 24 17:55:55.258085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-VolumesNegativeTest-2077208027 Aug 24 17:55:55.258085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-VolumesNegativeTest-2077208027-project Aug 24 17:55:55.258085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:55:55.258085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:55:55.258085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 49a8558950d34fdba5ab39c70f472cad Aug 24 17:55:55.258085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-VolumesNegativeTest-2077208027-project Aug 24 17:55:55.258085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Aug 24 17:55:55.258085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-597489273", "metadata": {"Type": "work"}}} Aug 24 17:55:55.258085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: Aug 24 17:55:55.258085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-597489273', 'metadata': {'Type': 'work'}}}} Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise error Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi '0' Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:55.259485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:55.261193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:55:55.261193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:55:55.261193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:55.261193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:55.261193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 17:55:55.261193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 17:55:55.261193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 17:55:55.261193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 17:55:55.261193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 17:55:55.261193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 17:55:55.261193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 17:55:55.261193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.261193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:55.261193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.261193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.261193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:55.261193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:55.261193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 17:55:55.261193 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 17:55:55.262480 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 17:55:55.262480 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.262480 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e312bc90-d601-4c5d-9083-455b895feb52 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:55.262480 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e312bc90-d601-4c5d-9083-455b895feb52 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009375 Aug 24 17:55:55.262480 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 485/981] 10.222.0.76 () {60 vars in 1156 bytes} [Wed Aug 24 17:55:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:55:55.269023 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-14385a0d-02ce-40a8-ac49-58ee81795d78 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] Action: 'create', calling method: .version_select at 0x7fce77398160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2085898659", "metadata": {"Type": "work"}}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-14385a0d-02ce-40a8-ac49-58ee81795d78 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] Request method failure captured: Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 119 Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmYqGhftafPc1UjOFM15T1o2o2-i-jKU8-ZAo5hHn_T3ESTgEB15hyeGm1iDyHOdKQacoxhnAaliLTCQ38TRBmgra_n3PNMbcUKSZNMOz1MT1YGTDWcfiLN-p0U8_wyFMI-B_LT384mcSop40h6khAz8XFvULvTwjJ5Z3Gwp6-dUCuc Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: bbc74a757d3c4e29aa1d1448f659a706 Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-VolumesNegativeTest-2077208027 Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:55:55.273043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:55:55.275252 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bbc74a757d3c4e29aa1d1448f659a706"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bbc74a757d3c4e29aa1d1448f659a706"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bbc74a757d3c4e29aa1d1448f659a706", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bbc74a757d3c4e29aa1d1448f659a706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:55:55.275252 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-VolumesNegativeTest-2077208027 Aug 24 17:55:55.275252 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: bbc74a757d3c4e29aa1d1448f659a706 Aug 24 17:55:55.275252 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-VolumesNegativeTest-2077208027 Aug 24 17:55:55.275252 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-VolumesNegativeTest-2077208027-project Aug 24 17:55:55.275252 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:55:55.275252 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:55:55.275252 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 49a8558950d34fdba5ab39c70f472cad Aug 24 17:55:55.275252 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-VolumesNegativeTest-2077208027-project Aug 24 17:55:55.275252 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Aug 24 17:55:55.275252 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2085898659", "metadata": {"Type": "work"}}} Aug 24 17:55:55.275252 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: Aug 24 17:55:55.275252 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2085898659', 'metadata': {'Type': 'work'}}}} Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise error Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi '' Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:55.276309 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:55.278220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:55:55.278220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:55:55.278220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:55.278220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:55.278220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 17:55:55.278220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 17:55:55.278220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 17:55:55.278220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 17:55:55.278220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 17:55:55.278220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 17:55:55.278220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 17:55:55.278220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.278220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:55.278220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.278220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.278220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:55.278220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:55.278220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 17:55:55.278220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 17:55:55.279644 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 17:55:55.279644 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.279644 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-14385a0d-02ce-40a8-ac49-58ee81795d78 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:55.279644 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-14385a0d-02ce-40a8-ac49-58ee81795d78 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010519 Aug 24 17:55:55.279644 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 486/982] 10.222.0.76 () {60 vars in 1156 bytes} [Wed Aug 24 17:55:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 17:55:55.289014 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-61f6711c-6fd7-4169-ad7f-dadc04b68938 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] Calling method '.version_select at 0x7fce772fc4c0>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:55.320481 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-61f6711c-6fd7-4169-ad7f-dadc04b68938 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] HTTP exception thrown: Volume tempest-invalid-2074833412 could not be found. Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-61f6711c-6fd7-4169-ad7f-dadc04b68938 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] Request method failure captured: Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2074833412 HTTP/1.1 Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmYqGhftafPc1UjOFM15T1o2o2-i-jKU8-ZAo5hHn_T3ESTgEB15hyeGm1iDyHOdKQacoxhnAaliLTCQ38TRBmgra_n3PNMbcUKSZNMOz1MT1YGTDWcfiLN-p0U8_wyFMI-B_LT384mcSop40h6khAz8XFvULvTwjJ5Z3Gwp6-dUCuc Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: bbc74a757d3c4e29aa1d1448f659a706 Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-VolumesNegativeTest-2077208027 Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:55:55.322518 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:55:55.324335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bbc74a757d3c4e29aa1d1448f659a706"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bbc74a757d3c4e29aa1d1448f659a706"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bbc74a757d3c4e29aa1d1448f659a706", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bbc74a757d3c4e29aa1d1448f659a706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:55:55.324335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-VolumesNegativeTest-2077208027 Aug 24 17:55:55.324335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: bbc74a757d3c4e29aa1d1448f659a706 Aug 24 17:55:55.324335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-VolumesNegativeTest-2077208027 Aug 24 17:55:55.324335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-VolumesNegativeTest-2077208027-project Aug 24 17:55:55.324335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:55:55.324335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:55:55.324335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 49a8558950d34fdba5ab39c70f472cad Aug 24 17:55:55.324335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-VolumesNegativeTest-2077208027-project Aug 24 17:55:55.324335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: Aug 24 17:55:55.324335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Volume tempest-invalid-2074833412 could not be found. Aug 24 17:55:55.324335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': 'tempest-invalid-2074833412'} Aug 24 17:55:55.324335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:55.325253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.325253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:55:55.325253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:55:55.325253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:55:55.325253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:55:55.325253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:55:55.325253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:55:55.325253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:55:55.325253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:55:55.325253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:55:55.325253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:55:55.325253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:55:55.325253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:55:55.325253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:55:55.325253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:55:55.325253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2074833412 could not be found. (HTTP 404) (Request-ID: req-493f449f-7128-40a9-a0d8-cba6b825b1f9) Aug 24 17:55:55.325253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.325253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:55.325253 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.326665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.326665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 17:55:55.326665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 17:55:55.326665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:55:55.326665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:55:55.326665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:55:55.326665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:55:55.326665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:55:55.326665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:55:55.326665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:55:55.326665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:55:55.326665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:55:55.326665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:55:55.326665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:55:55.326665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:55:55.326665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:55:55.326665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:55:55.326665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:55:55.326665 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2074833412 could not be found. Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:55:55.327958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2074833412 could not be found. Aug 24 17:55:55.329325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.329325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:55.329325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.329325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.329325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:55.329325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:55.329325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:55:55.329325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:55:55.329325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2074833412 could not be found. Aug 24 17:55:55.329325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.329325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-61f6711c-6fd7-4169-ad7f-dadc04b68938 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] Returning 404 to user: Volume tempest-invalid-2074833412 could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:55.329325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-61f6711c-6fd7-4169-ad7f-dadc04b68938 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2074833412" status: 404 len: 99 microversion: 2.1 time: 0.039655 Aug 24 17:55:55.329325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 487/983] 10.222.0.76 () {58 vars in 1218 bytes} [Wed Aug 24 17:55:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2074833412 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 17:55:55.334252 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-9273013f-c22f-469a-aa99-32940003e22e tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003590 Aug 24 17:55:55.334732 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 488/984] 10.222.0.76 () {58 vars in 1140 bytes} [Wed Aug 24 17:55:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 17:55:55.348630 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-9e97db9f-ff28-4e1f-8002-5fc9b451b856 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003491 Aug 24 17:55:55.349114 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 489/985] 10.222.0.76 () {58 vars in 1137 bytes} [Wed Aug 24 17:55:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 24 17:55:55.357810 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-186455a9-9a4d-4c81-bb27-b52509e30eb9 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] Calling method '.version_select at 0x7fce7d94a670>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:55.385760 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-186455a9-9a4d-4c81-bb27-b52509e30eb9 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] HTTP exception thrown: Volume 967f4179-4ba8-4342-89a7-271237be8483 could not be found. Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-186455a9-9a4d-4c81-bb27-b52509e30eb9 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] Request method failure captured: Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: DELETE /compute/v2.1/os-volumes/967f4179-4ba8-4342-89a7-271237be8483 HTTP/1.1 Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmYqGhftafPc1UjOFM15T1o2o2-i-jKU8-ZAo5hHn_T3ESTgEB15hyeGm1iDyHOdKQacoxhnAaliLTCQ38TRBmgra_n3PNMbcUKSZNMOz1MT1YGTDWcfiLN-p0U8_wyFMI-B_LT384mcSop40h6khAz8XFvULvTwjJ5Z3Gwp6-dUCuc Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: bbc74a757d3c4e29aa1d1448f659a706 Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-VolumesNegativeTest-2077208027 Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:55:55.388160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:55:55.389711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bbc74a757d3c4e29aa1d1448f659a706"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bbc74a757d3c4e29aa1d1448f659a706"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bbc74a757d3c4e29aa1d1448f659a706", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bbc74a757d3c4e29aa1d1448f659a706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:55:55.389711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-VolumesNegativeTest-2077208027 Aug 24 17:55:55.389711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: bbc74a757d3c4e29aa1d1448f659a706 Aug 24 17:55:55.389711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-VolumesNegativeTest-2077208027 Aug 24 17:55:55.389711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-VolumesNegativeTest-2077208027-project Aug 24 17:55:55.389711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:55:55.389711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:55:55.389711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 49a8558950d34fdba5ab39c70f472cad Aug 24 17:55:55.389711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-VolumesNegativeTest-2077208027-project Aug 24 17:55:55.389711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: Aug 24 17:55:55.389711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Volume 967f4179-4ba8-4342-89a7-271237be8483 could not be found. Aug 24 17:55:55.389711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': '967f4179-4ba8-4342-89a7-271237be8483'} Aug 24 17:55:55.389711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:55.390694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.390694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:55:55.390694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:55:55.390694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:55:55.390694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:55:55.390694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:55:55.390694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:55:55.390694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:55:55.390694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:55:55.390694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:55:55.390694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:55:55.390694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:55:55.390694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:55:55.390694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:55:55.390694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:55:55.390694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 967f4179-4ba8-4342-89a7-271237be8483 could not be found. (HTTP 404) (Request-ID: req-b3156ada-9f7b-42c3-918b-af06a93e2e4e) Aug 24 17:55:55.390694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.390694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:55.390694 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.392100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.392100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 17:55:55.392100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 17:55:55.392100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:55:55.392100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:55:55.392100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:55:55.392100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:55:55.392100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:55:55.392100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:55:55.392100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:55:55.392100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:55:55.392100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:55:55.392100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:55:55.392100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:55:55.392100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:55:55.392100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:55:55.392100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:55:55.392100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:55:55.392100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:55:55.393599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:55:55.393599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:55:55.393599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:55:55.393599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:55:55.393599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 967f4179-4ba8-4342-89a7-271237be8483 could not be found. Aug 24 17:55:55.393599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.393599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:55.393599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.393599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.393599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:55.393599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:55.393599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:55.393599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:55.393599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:55:55.393599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:55:55.393599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:55.393599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:55.393599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 17:55:55.393599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:55:55.395279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 967f4179-4ba8-4342-89a7-271237be8483 could not be found. Aug 24 17:55:55.395279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.395279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:55.395279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.395279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.395279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:55.395279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:55.395279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:55:55.395279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:55:55.395279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 967f4179-4ba8-4342-89a7-271237be8483 could not be found. Aug 24 17:55:55.395279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.395279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-186455a9-9a4d-4c81-bb27-b52509e30eb9 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] Returning 404 to user: Volume 967f4179-4ba8-4342-89a7-271237be8483 could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:55.395279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-186455a9-9a4d-4c81-bb27-b52509e30eb9 tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/967f4179-4ba8-4342-89a7-271237be8483" status: 404 len: 109 microversion: 2.1 time: 0.036112 Aug 24 17:55:55.395279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 490/986] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 24 17:55:55 2022] DELETE /compute/v2.1/os-volumes/967f4179-4ba8-4342-89a7-271237be8483 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:55:55.400058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f11e3099-2713-4fcb-bda4-82a88865910d tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] Calling method '.version_select at 0x7fce77398f70>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:55.430888 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-f11e3099-2713-4fcb-bda4-82a88865910d tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] HTTP exception thrown: Volume 8b7f7cfd-0a75-4e1e-82bd-544c8d78a9f6 could not be found. Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f11e3099-2713-4fcb-bda4-82a88865910d tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] Request method failure captured: Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: GET /compute/v2.1/os-volumes/8b7f7cfd-0a75-4e1e-82bd-544c8d78a9f6 HTTP/1.1 Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmYqGhftafPc1UjOFM15T1o2o2-i-jKU8-ZAo5hHn_T3ESTgEB15hyeGm1iDyHOdKQacoxhnAaliLTCQ38TRBmgra_n3PNMbcUKSZNMOz1MT1YGTDWcfiLN-p0U8_wyFMI-B_LT384mcSop40h6khAz8XFvULvTwjJ5Z3Gwp6-dUCuc Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: bbc74a757d3c4e29aa1d1448f659a706 Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-VolumesNegativeTest-2077208027 Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:55:55.433332 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:55:55.434937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bbc74a757d3c4e29aa1d1448f659a706"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bbc74a757d3c4e29aa1d1448f659a706"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bbc74a757d3c4e29aa1d1448f659a706", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bbc74a757d3c4e29aa1d1448f659a706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:55:55.434937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-VolumesNegativeTest-2077208027 Aug 24 17:55:55.434937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: bbc74a757d3c4e29aa1d1448f659a706 Aug 24 17:55:55.434937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-VolumesNegativeTest-2077208027 Aug 24 17:55:55.434937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-VolumesNegativeTest-2077208027-project Aug 24 17:55:55.434937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:55:55.434937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:55:55.434937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 49a8558950d34fdba5ab39c70f472cad Aug 24 17:55:55.434937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-VolumesNegativeTest-2077208027-project Aug 24 17:55:55.434937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: Aug 24 17:55:55.434937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Volume 8b7f7cfd-0a75-4e1e-82bd-544c8d78a9f6 could not be found. Aug 24 17:55:55.434937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': '8b7f7cfd-0a75-4e1e-82bd-544c8d78a9f6'} Aug 24 17:55:55.434937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:55.435769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.435769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:55:55.435769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:55:55.435769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:55:55.435769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:55:55.435769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:55:55.435769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:55:55.435769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:55:55.435769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:55:55.435769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:55:55.435769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:55:55.435769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:55:55.435769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:55:55.435769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:55:55.435769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:55:55.435769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8b7f7cfd-0a75-4e1e-82bd-544c8d78a9f6 could not be found. (HTTP 404) (Request-ID: req-168ae911-eb7e-4cae-afff-226393c05af8) Aug 24 17:55:55.435769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.435769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:55.435769 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.437098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.437098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 17:55:55.437098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 17:55:55.437098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:55:55.437098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:55:55.437098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:55:55.437098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:55:55.437098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:55:55.437098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:55:55.437098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:55:55.437098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:55:55.437098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:55:55.437098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:55:55.437098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:55:55.437098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:55:55.437098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:55:55.437098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:55:55.437098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:55:55.437098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:55:55.444533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:55:55.444533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:55:55.444533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:55:55.444533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:55:55.444533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8b7f7cfd-0a75-4e1e-82bd-544c8d78a9f6 could not be found. Aug 24 17:55:55.444533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.444533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:55.444533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.444533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.444533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:55.444533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:55.444533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:55.444533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:55.444533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:55:55.444533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:55:55.444533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:55.444533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:55.444533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 17:55:55.444533 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:55:55.446342 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8b7f7cfd-0a75-4e1e-82bd-544c8d78a9f6 could not be found. Aug 24 17:55:55.446342 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.446342 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:55.446342 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.446342 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:55.446342 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:55.446342 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:55.446342 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:55:55.446342 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:55:55.446342 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8b7f7cfd-0a75-4e1e-82bd-544c8d78a9f6 could not be found. Aug 24 17:55:55.446342 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:55:55.446342 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f11e3099-2713-4fcb-bda4-82a88865910d tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] Returning 404 to user: Volume 8b7f7cfd-0a75-4e1e-82bd-544c8d78a9f6 could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:55.446342 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f11e3099-2713-4fcb-bda4-82a88865910d tempest-VolumesNegativeTest-2077208027 tempest-VolumesNegativeTest-2077208027-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/8b7f7cfd-0a75-4e1e-82bd-544c8d78a9f6" status: 404 len: 109 microversion: 2.1 time: 0.039573 Aug 24 17:55:55.446342 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 491/987] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 17:55:55 2022] GET /compute/v2.1/os-volumes/8b7f7cfd-0a75-4e1e-82bd-544c8d78a9f6 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:55:55.463192 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8913b444-1fbe-4c3d-9dee-858e0581890d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:55.464299 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8913b444-1fbe-4c3d-9dee-858e0581890d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:55.470626 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8913b444-1fbe-4c3d-9dee-858e0581890d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:55.471118 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8913b444-1fbe-4c3d-9dee-858e0581890d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:55.471596 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8913b444-1fbe-4c3d-9dee-858e0581890d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:55.478519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8913b444-1fbe-4c3d-9dee-858e0581890d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:55.478519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8913b444-1fbe-4c3d-9dee-858e0581890d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:55.478519 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8913b444-1fbe-4c3d-9dee-858e0581890d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:55.624335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8913b444-1fbe-4c3d-9dee-858e0581890d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:55.638304 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-8913b444-1fbe-4c3d-9dee-858e0581890d tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1267 microversion: 2.1 time: 0.178443 Aug 24 17:55:55.639325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 492/988] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:55 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:55.971187 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-80a11a13-3347-48e6-8585-160e88bb6b33 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "POST /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.894556 Aug 24 17:55:55.975328 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 497/989] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 17:55:55 2022] POST /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b/os-volume_attachments => generated 194 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:56.665721 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b252915f-c91f-4c4c-83a3-b847db18ffdb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:56.666387 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-b252915f-c91f-4c4c-83a3-b847db18ffdb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:56.673734 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b252915f-c91f-4c4c-83a3-b847db18ffdb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:56.674443 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b252915f-c91f-4c4c-83a3-b847db18ffdb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:56.674889 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b252915f-c91f-4c4c-83a3-b847db18ffdb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:56.675598 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b252915f-c91f-4c4c-83a3-b847db18ffdb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:56.676059 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b252915f-c91f-4c4c-83a3-b847db18ffdb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:56.676715 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b252915f-c91f-4c4c-83a3-b847db18ffdb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:56.829678 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b252915f-c91f-4c4c-83a3-b847db18ffdb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:56.837818 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b252915f-c91f-4c4c-83a3-b847db18ffdb tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1267 microversion: 2.1 time: 0.178808 Aug 24 17:55:56.839250 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 493/990] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:56 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:57.861737 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-bdcfe7f5-e88b-4b48-a118-52533399e534 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:57.862512 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-bdcfe7f5-e88b-4b48-a118-52533399e534 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:57.869487 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bdcfe7f5-e88b-4b48-a118-52533399e534 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:57.870593 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bdcfe7f5-e88b-4b48-a118-52533399e534 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:57.871049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bdcfe7f5-e88b-4b48-a118-52533399e534 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:57.871804 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bdcfe7f5-e88b-4b48-a118-52533399e534 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:57.872272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bdcfe7f5-e88b-4b48-a118-52533399e534 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:57.872701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bdcfe7f5-e88b-4b48-a118-52533399e534 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:58.026051 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-bdcfe7f5-e88b-4b48-a118-52533399e534 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:58.034780 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-bdcfe7f5-e88b-4b48-a118-52533399e534 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1267 microversion: 2.1 time: 0.178172 Aug 24 17:55:58.037594 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 498/991] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:57 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:58.596231 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-108a455d-c5c5-4736-8955-a0423d8d6cf0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:58.599993 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-108a455d-c5c5-4736-8955-a0423d8d6cf0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:58.612878 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-108a455d-c5c5-4736-8955-a0423d8d6cf0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:58.614243 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-108a455d-c5c5-4736-8955-a0423d8d6cf0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:58.615102 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-108a455d-c5c5-4736-8955-a0423d8d6cf0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:58.616267 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-108a455d-c5c5-4736-8955-a0423d8d6cf0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:58.617126 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-108a455d-c5c5-4736-8955-a0423d8d6cf0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:58.617843 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-108a455d-c5c5-4736-8955-a0423d8d6cf0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:58.662407 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-108a455d-c5c5-4736-8955-a0423d8d6cf0 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.075354 Aug 24 17:55:58.662986 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 494/992] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:55:58 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:58.807880 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-754adeec-cff7-45b4-b04c-d51c3337a03c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:58.808469 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-754adeec-cff7-45b4-b04c-d51c3337a03c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:58.815356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-754adeec-cff7-45b4-b04c-d51c3337a03c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:58.815842 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-754adeec-cff7-45b4-b04c-d51c3337a03c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:58.816280 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-754adeec-cff7-45b4-b04c-d51c3337a03c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:58.816985 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-754adeec-cff7-45b4-b04c-d51c3337a03c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:58.817439 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-754adeec-cff7-45b4-b04c-d51c3337a03c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:58.817887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-754adeec-cff7-45b4-b04c-d51c3337a03c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:58.855320 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-754adeec-cff7-45b4-b04c-d51c3337a03c tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments/b2bdcc61-a323-42b9-9488-c9fc92c74550" status: 200 len: 194 microversion: 2.1 time: 0.052063 Aug 24 17:55:58.861262 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 499/993] 10.222.0.76 () {58 vars in 1413 bytes} [Wed Aug 24 17:55:58 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments/b2bdcc61-a323-42b9-9488-c9fc92c74550 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:58.867221 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7450538d-8d34-4bb2-aafc-f7ab72705a89 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:58.867731 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7450538d-8d34-4bb2-aafc-f7ab72705a89 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:58.875994 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7450538d-8d34-4bb2-aafc-f7ab72705a89 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:58.876789 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7450538d-8d34-4bb2-aafc-f7ab72705a89 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:58.877222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7450538d-8d34-4bb2-aafc-f7ab72705a89 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:58.878215 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7450538d-8d34-4bb2-aafc-f7ab72705a89 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:58.878732 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7450538d-8d34-4bb2-aafc-f7ab72705a89 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:58.879227 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7450538d-8d34-4bb2-aafc-f7ab72705a89 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:58.993567 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-7450538d-8d34-4bb2-aafc-f7ab72705a89 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lazy-loading 'services' on Instance uuid c778621a-6f96-42dd-926e-a398bb219880 {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:55:59.056693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9b6a80e7-e753-482e-a871-3f043a3c9005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:59.057902 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9b6a80e7-e753-482e-a871-3f043a3c9005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:59.065387 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9b6a80e7-e753-482e-a871-3f043a3c9005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:59.065958 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9b6a80e7-e753-482e-a871-3f043a3c9005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:59.066399 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9b6a80e7-e753-482e-a871-3f043a3c9005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:59.067103 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9b6a80e7-e753-482e-a871-3f043a3c9005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:59.067554 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9b6a80e7-e753-482e-a871-3f043a3c9005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:59.067976 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9b6a80e7-e753-482e-a871-3f043a3c9005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:59.212985 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9b6a80e7-e753-482e-a871-3f043a3c9005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:59.221335 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9b6a80e7-e753-482e-a871-3f043a3c9005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1267 microversion: 2.1 time: 0.168869 Aug 24 17:55:59.221953 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 500/994] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:59 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:59.300157 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7450538d-8d34-4bb2-aafc-f7ab72705a89 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments/b2bdcc61-a323-42b9-9488-c9fc92c74550" status: 202 len: 0 microversion: 2.1 time: 0.436953 Aug 24 17:55:59.300699 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 495/995] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 17:55:58 2022] DELETE /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments/b2bdcc61-a323-42b9-9488-c9fc92c74550 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:56:00.242788 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-849ec5eb-dd20-4c36-a647-df8600966418 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:00.243530 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-849ec5eb-dd20-4c36-a647-df8600966418 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:00.250791 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-849ec5eb-dd20-4c36-a647-df8600966418 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:00.251274 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-849ec5eb-dd20-4c36-a647-df8600966418 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:00.251736 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-849ec5eb-dd20-4c36-a647-df8600966418 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:00.252436 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-849ec5eb-dd20-4c36-a647-df8600966418 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:00.253005 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-849ec5eb-dd20-4c36-a647-df8600966418 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:00.253429 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-849ec5eb-dd20-4c36-a647-df8600966418 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:00.411762 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-849ec5eb-dd20-4c36-a647-df8600966418 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:00.435719 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-849ec5eb-dd20-4c36-a647-df8600966418 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1267 microversion: 2.1 time: 0.196734 Aug 24 17:56:00.436411 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 501/996] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:00 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:01.463268 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-257df41a-f771-4cce-b91d-a7cd46638276 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:01.465878 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-257df41a-f771-4cce-b91d-a7cd46638276 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:01.478695 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-257df41a-f771-4cce-b91d-a7cd46638276 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:01.480301 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-257df41a-f771-4cce-b91d-a7cd46638276 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:01.493391 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-257df41a-f771-4cce-b91d-a7cd46638276 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:01.493391 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-257df41a-f771-4cce-b91d-a7cd46638276 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:01.493391 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-257df41a-f771-4cce-b91d-a7cd46638276 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:01.493391 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-257df41a-f771-4cce-b91d-a7cd46638276 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:01.637302 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-257df41a-f771-4cce-b91d-a7cd46638276 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:01.645381 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-257df41a-f771-4cce-b91d-a7cd46638276 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1267 microversion: 2.1 time: 0.191865 Aug 24 17:56:01.646047 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 496/997] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:01 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:01.981910 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-37d37a8c-38b6-4db9-8c1e-885b8733ca3f req-fc538693-e81e-49f2-85d3-a58b49d70421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa9d4f71-3435-4fe1-94c1-3c2aa90852e0", "name": "network-vif-plugged", "status": "completed", "tag": "a5b4bf67-96d5-4f27-af69-f55896b0c827"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:01.992766 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-37d37a8c-38b6-4db9-8c1e-885b8733ca3f req-fc538693-e81e-49f2-85d3-a58b49d70421 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:01.993242 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-37d37a8c-38b6-4db9-8c1e-885b8733ca3f req-fc538693-e81e-49f2-85d3-a58b49d70421 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:01.993673 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-37d37a8c-38b6-4db9-8c1e-885b8733ca3f req-fc538693-e81e-49f2-85d3-a58b49d70421 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:02.005138 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-37d37a8c-38b6-4db9-8c1e-885b8733ca3f req-fc538693-e81e-49f2-85d3-a58b49d70421 service nova] Creating event network-vif-plugged:a5b4bf67-96d5-4f27-af69-f55896b0c827 for instance aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 on hv-cinder-85442 Aug 24 17:56:02.009935 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-37d37a8c-38b6-4db9-8c1e-885b8733ca3f req-fc538693-e81e-49f2-85d3-a58b49d70421 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032013 Aug 24 17:56:02.010534 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 502/998] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:02.666879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5c57a7ca-53b0-4ef3-91ce-94a4866188c4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:02.667536 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5c57a7ca-53b0-4ef3-91ce-94a4866188c4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:02.675098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5c57a7ca-53b0-4ef3-91ce-94a4866188c4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:02.675589 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5c57a7ca-53b0-4ef3-91ce-94a4866188c4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:02.676075 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5c57a7ca-53b0-4ef3-91ce-94a4866188c4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:02.676792 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5c57a7ca-53b0-4ef3-91ce-94a4866188c4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:02.677235 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5c57a7ca-53b0-4ef3-91ce-94a4866188c4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:02.677693 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5c57a7ca-53b0-4ef3-91ce-94a4866188c4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:02.694607 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:02.852207 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5c57a7ca-53b0-4ef3-91ce-94a4866188c4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:02.861226 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5c57a7ca-53b0-4ef3-91ce-94a4866188c4 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1267 microversion: 2.1 time: 0.198187 Aug 24 17:56:02.861807 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 497/999] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:02 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:03.885573 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-160e79f4-30d3-4bdc-a697-2fd821005f5f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:03.887338 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-160e79f4-30d3-4bdc-a697-2fd821005f5f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:03.895836 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-160e79f4-30d3-4bdc-a697-2fd821005f5f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:03.896344 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-160e79f4-30d3-4bdc-a697-2fd821005f5f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:03.896802 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-160e79f4-30d3-4bdc-a697-2fd821005f5f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:03.897577 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-160e79f4-30d3-4bdc-a697-2fd821005f5f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:03.898874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-160e79f4-30d3-4bdc-a697-2fd821005f5f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:03.898874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-160e79f4-30d3-4bdc-a697-2fd821005f5f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:04.118463 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-160e79f4-30d3-4bdc-a697-2fd821005f5f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:04.126809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-160e79f4-30d3-4bdc-a697-2fd821005f5f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1454 microversion: 2.1 time: 0.247617 Aug 24 17:56:04.127388 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 503/1000] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:03 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1454 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:04.151105 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-6eb03e53-db92-4059-a42a-d5d2eeae9e35 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:04.151839 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-6eb03e53-db92-4059-a42a-d5d2eeae9e35 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:04.168847 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6eb03e53-db92-4059-a42a-d5d2eeae9e35 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:04.169377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6eb03e53-db92-4059-a42a-d5d2eeae9e35 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:04.169814 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6eb03e53-db92-4059-a42a-d5d2eeae9e35 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:04.170554 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6eb03e53-db92-4059-a42a-d5d2eeae9e35 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:04.171043 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6eb03e53-db92-4059-a42a-d5d2eeae9e35 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:04.171465 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6eb03e53-db92-4059-a42a-d5d2eeae9e35 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:04.322603 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-6eb03e53-db92-4059-a42a-d5d2eeae9e35 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:04.332483 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-6eb03e53-db92-4059-a42a-d5d2eeae9e35 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1454 microversion: 2.1 time: 0.186542 Aug 24 17:56:04.333059 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 498/1001] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:04 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1454 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:56:06.018511 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ee0231c4-59b7-4309-9a5a-da6e98212693 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:06.019034 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ee0231c4-59b7-4309-9a5a-da6e98212693 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:06.025732 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee0231c4-59b7-4309-9a5a-da6e98212693 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:06.028840 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee0231c4-59b7-4309-9a5a-da6e98212693 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:06.028840 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee0231c4-59b7-4309-9a5a-da6e98212693 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:06.028840 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee0231c4-59b7-4309-9a5a-da6e98212693 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:06.028840 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee0231c4-59b7-4309-9a5a-da6e98212693 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:06.029292 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ee0231c4-59b7-4309-9a5a-da6e98212693 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:06.124179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-ee0231c4-59b7-4309-9a5a-da6e98212693 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lazy-loading 'services' on Instance uuid 5a759f40-8f53-4041-85f4-6f56cdded52b {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:56:06.450239 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ee0231c4-59b7-4309-9a5a-da6e98212693 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b/os-volume_attachments/709d0a03-af8e-4c36-869c-5cf5cf36d246" status: 202 len: 0 microversion: 2.1 time: 0.434979 Aug 24 17:56:06.451656 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 504/1002] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 17:56:06 2022] DELETE /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b/os-volume_attachments/709d0a03-af8e-4c36-869c-5cf5cf36d246 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:56:06.468469 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-260cc849-81c6-4fd3-aff5-d8d39d571e27 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:06.471493 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-260cc849-81c6-4fd3-aff5-d8d39d571e27 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:06.479582 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-260cc849-81c6-4fd3-aff5-d8d39d571e27 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:06.480559 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-260cc849-81c6-4fd3-aff5-d8d39d571e27 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:06.481316 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-260cc849-81c6-4fd3-aff5-d8d39d571e27 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:06.481721 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-260cc849-81c6-4fd3-aff5-d8d39d571e27 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:06.482412 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-260cc849-81c6-4fd3-aff5-d8d39d571e27 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:06.482849 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-260cc849-81c6-4fd3-aff5-d8d39d571e27 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:06.518098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-260cc849-81c6-4fd3-aff5-d8d39d571e27 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053291 Aug 24 17:56:06.518991 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 499/1003] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:56:06 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:06.944309 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-2c419661-9ceb-4227-a6c8-cb2c01fb3767 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:06.945273 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-2c419661-9ceb-4227-a6c8-cb2c01fb3767 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:06.952709 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2c419661-9ceb-4227-a6c8-cb2c01fb3767 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:06.953211 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2c419661-9ceb-4227-a6c8-cb2c01fb3767 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:06.953807 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2c419661-9ceb-4227-a6c8-cb2c01fb3767 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:06.954540 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2c419661-9ceb-4227-a6c8-cb2c01fb3767 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:06.954997 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2c419661-9ceb-4227-a6c8-cb2c01fb3767 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:06.973775 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2c419661-9ceb-4227-a6c8-cb2c01fb3767 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:06.974040 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-bcf04c5d-9934-465d-a7bf-8f80e2ca8054 req-7362bd73-189f-45c5-8d62-d83fd938da51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa9d4f71-3435-4fe1-94c1-3c2aa90852e0", "tag": "a5b4bf67-96d5-4f27-af69-f55896b0c827"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:06.974040 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-bcf04c5d-9934-465d-a7bf-8f80e2ca8054 req-7362bd73-189f-45c5-8d62-d83fd938da51 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:06.974040 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-bcf04c5d-9934-465d-a7bf-8f80e2ca8054 req-7362bd73-189f-45c5-8d62-d83fd938da51 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:06.974040 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-bcf04c5d-9934-465d-a7bf-8f80e2ca8054 req-7362bd73-189f-45c5-8d62-d83fd938da51 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:06.986240 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-bcf04c5d-9934-465d-a7bf-8f80e2ca8054 req-7362bd73-189f-45c5-8d62-d83fd938da51 service nova] Creating event network-changed:a5b4bf67-96d5-4f27-af69-f55896b0c827 for instance aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 on hv-cinder-85442 Aug 24 17:56:06.991863 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-bcf04c5d-9934-465d-a7bf-8f80e2ca8054 req-7362bd73-189f-45c5-8d62-d83fd938da51 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034902 Aug 24 17:56:06.992757 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 500/1004] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:56:07.008004 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-2c419661-9ceb-4227-a6c8-cb2c01fb3767 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments/be00e666-e2b8-4810-8470-af0b9c484097" status: 200 len: 194 microversion: 2.1 time: 0.071488 Aug 24 17:56:07.021540 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-9d69fa1a-1aef-4c30-a652-b54feff157ff tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:07.022527 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-9d69fa1a-1aef-4c30-a652-b54feff157ff tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:07.026031 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 505/1005] 10.222.0.76 () {58 vars in 1413 bytes} [Wed Aug 24 17:56:06 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments/be00e666-e2b8-4810-8470-af0b9c484097 => generated 194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:07.031132 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9d69fa1a-1aef-4c30-a652-b54feff157ff tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:07.036651 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9d69fa1a-1aef-4c30-a652-b54feff157ff tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:07.036651 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9d69fa1a-1aef-4c30-a652-b54feff157ff tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:07.036651 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9d69fa1a-1aef-4c30-a652-b54feff157ff tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:07.036651 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9d69fa1a-1aef-4c30-a652-b54feff157ff tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:07.037298 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9d69fa1a-1aef-4c30-a652-b54feff157ff tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:07.174419 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-9d69fa1a-1aef-4c30-a652-b54feff157ff tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lazy-loading 'services' on Instance uuid c778621a-6f96-42dd-926e-a398bb219880 {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:56:07.536089 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c62d9129-2ebf-4a18-94f1-e19b52effc53 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:07.536275 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-9d69fa1a-1aef-4c30-a652-b54feff157ff tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments/be00e666-e2b8-4810-8470-af0b9c484097" status: 202 len: 0 microversion: 2.1 time: 0.517614 Aug 24 17:56:07.538410 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c62d9129-2ebf-4a18-94f1-e19b52effc53 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:07.550607 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c62d9129-2ebf-4a18-94f1-e19b52effc53 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:07.551474 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c62d9129-2ebf-4a18-94f1-e19b52effc53 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:07.552473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c62d9129-2ebf-4a18-94f1-e19b52effc53 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:07.554044 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c62d9129-2ebf-4a18-94f1-e19b52effc53 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:07.555064 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c62d9129-2ebf-4a18-94f1-e19b52effc53 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:07.556052 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c62d9129-2ebf-4a18-94f1-e19b52effc53 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:07.565408 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 501/1006] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 17:56:07 2022] DELETE /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments/be00e666-e2b8-4810-8470-af0b9c484097 => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:56:07.596153 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c62d9129-2ebf-4a18-94f1-e19b52effc53 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068864 Aug 24 17:56:07.597425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 506/1007] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:56:07 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:08.610321 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-de62381d-6e7a-4fff-bcd8-d07e325ff4b7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:08.613152 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-de62381d-6e7a-4fff-bcd8-d07e325ff4b7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:08.621830 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-de62381d-6e7a-4fff-bcd8-d07e325ff4b7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:08.623046 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-de62381d-6e7a-4fff-bcd8-d07e325ff4b7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:08.623046 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-de62381d-6e7a-4fff-bcd8-d07e325ff4b7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:08.623559 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-de62381d-6e7a-4fff-bcd8-d07e325ff4b7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:08.624025 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-de62381d-6e7a-4fff-bcd8-d07e325ff4b7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:08.624460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-de62381d-6e7a-4fff-bcd8-d07e325ff4b7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:08.658778 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-de62381d-6e7a-4fff-bcd8-d07e325ff4b7 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053707 Aug 24 17:56:08.659335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 502/1008] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:56:08 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:56:08.727930 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4df32071-6cf1-4eda-b956-2c58be8d435f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:08.728562 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4df32071-6cf1-4eda-b956-2c58be8d435f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:08.735277 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4df32071-6cf1-4eda-b956-2c58be8d435f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:08.736020 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4df32071-6cf1-4eda-b956-2c58be8d435f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:08.736460 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4df32071-6cf1-4eda-b956-2c58be8d435f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:08.737178 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4df32071-6cf1-4eda-b956-2c58be8d435f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:08.737628 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4df32071-6cf1-4eda-b956-2c58be8d435f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:08.738082 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4df32071-6cf1-4eda-b956-2c58be8d435f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:08.765640 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4df32071-6cf1-4eda-b956-2c58be8d435f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Going to try to terminate instance {{(pid=127677) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:56:08.794942 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:08.915090 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f2d3f162-1fbd-4cf8-81ef-a6812516b6c5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:08.917302 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f2d3f162-1fbd-4cf8-81ef-a6812516b6c5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:08.923451 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f2d3f162-1fbd-4cf8-81ef-a6812516b6c5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:08.923936 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f2d3f162-1fbd-4cf8-81ef-a6812516b6c5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:08.924375 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f2d3f162-1fbd-4cf8-81ef-a6812516b6c5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:08.925072 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f2d3f162-1fbd-4cf8-81ef-a6812516b6c5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:08.925543 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f2d3f162-1fbd-4cf8-81ef-a6812516b6c5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:08.925988 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f2d3f162-1fbd-4cf8-81ef-a6812516b6c5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:08.955809 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f2d3f162-1fbd-4cf8-81ef-a6812516b6c5 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044646 Aug 24 17:56:08.956433 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 503/1009] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:56:08 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 17:56:09.082457 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-244651af-1ba9-4232-ac5e-3827b141d21b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:09.084725 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-244651af-1ba9-4232-ac5e-3827b141d21b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:09.091722 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-244651af-1ba9-4232-ac5e-3827b141d21b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:09.092739 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-244651af-1ba9-4232-ac5e-3827b141d21b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:09.092739 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-244651af-1ba9-4232-ac5e-3827b141d21b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:09.093699 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-244651af-1ba9-4232-ac5e-3827b141d21b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:09.094217 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-244651af-1ba9-4232-ac5e-3827b141d21b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:09.094647 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-244651af-1ba9-4232-ac5e-3827b141d21b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:09.147446 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-244651af-1ba9-4232-ac5e-3827b141d21b tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051213 Aug 24 17:56:09.147446 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 504/1010] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 17:56:09 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 17:56:09.215049 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a28cf750-5aa3-484a-8b9b-6c43531f3191 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:09.215695 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a28cf750-5aa3-484a-8b9b-6c43531f3191 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:09.221896 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a28cf750-5aa3-484a-8b9b-6c43531f3191 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:09.222402 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a28cf750-5aa3-484a-8b9b-6c43531f3191 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:09.222849 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a28cf750-5aa3-484a-8b9b-6c43531f3191 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:09.223561 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a28cf750-5aa3-484a-8b9b-6c43531f3191 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:09.224018 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a28cf750-5aa3-484a-8b9b-6c43531f3191 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:09.224476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a28cf750-5aa3-484a-8b9b-6c43531f3191 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:09.252052 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a28cf750-5aa3-484a-8b9b-6c43531f3191 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Going to try to terminate instance {{(pid=127676) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:56:09.268289 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-4df32071-6cf1-4eda-b956-2c58be8d435f tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 204 len: 0 microversion: 2.1 time: 0.544110 Aug 24 17:56:09.269179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 507/1011] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:56:08 2022] DELETE /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:56:09.278179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-794408d9-03be-4675-be4d-5800fceac518 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:09.278874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-794408d9-03be-4675-be4d-5800fceac518 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:09.287453 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-794408d9-03be-4675-be4d-5800fceac518 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:09.287934 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-794408d9-03be-4675-be4d-5800fceac518 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:09.288396 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-794408d9-03be-4675-be4d-5800fceac518 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:09.289100 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-794408d9-03be-4675-be4d-5800fceac518 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:09.289607 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-794408d9-03be-4675-be4d-5800fceac518 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:09.290079 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-794408d9-03be-4675-be4d-5800fceac518 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:09.432638 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-794408d9-03be-4675-be4d-5800fceac518 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:09.441483 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-794408d9-03be-4675-be4d-5800fceac518 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 200 len: 1681 microversion: 2.1 time: 0.167650 Aug 24 17:56:09.442091 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 508/1012] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:09 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:09.725284 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a28cf750-5aa3-484a-8b9b-6c43531f3191 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 204 len: 0 microversion: 2.1 time: 0.514126 Aug 24 17:56:09.725910 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 505/1013] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:56:09 2022] DELETE /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:56:09.735387 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-76ae6595-99c1-46a9-8ee1-dea8578a0190 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:09.736176 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-76ae6595-99c1-46a9-8ee1-dea8578a0190 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:09.742713 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-76ae6595-99c1-46a9-8ee1-dea8578a0190 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:09.743206 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-76ae6595-99c1-46a9-8ee1-dea8578a0190 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:09.743647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-76ae6595-99c1-46a9-8ee1-dea8578a0190 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:09.744353 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-76ae6595-99c1-46a9-8ee1-dea8578a0190 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:09.744812 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-76ae6595-99c1-46a9-8ee1-dea8578a0190 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:09.745340 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-76ae6595-99c1-46a9-8ee1-dea8578a0190 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:09.902828 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-76ae6595-99c1-46a9-8ee1-dea8578a0190 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:09.911270 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-76ae6595-99c1-46a9-8ee1-dea8578a0190 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1673 microversion: 2.1 time: 0.179913 Aug 24 17:56:09.924322 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 509/1014] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:09 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1673 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:10.465571 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-6f032fd0-ae5f-42d4-b88a-2d5da9b070a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:10.466417 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-6f032fd0-ae5f-42d4-b88a-2d5da9b070a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:10.468467 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:10.476541 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6f032fd0-ae5f-42d4-b88a-2d5da9b070a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:10.477421 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6f032fd0-ae5f-42d4-b88a-2d5da9b070a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:10.479327 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6f032fd0-ae5f-42d4-b88a-2d5da9b070a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:10.479327 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6f032fd0-ae5f-42d4-b88a-2d5da9b070a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:10.480122 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6f032fd0-ae5f-42d4-b88a-2d5da9b070a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:10.480820 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6f032fd0-ae5f-42d4-b88a-2d5da9b070a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:10.642726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-6f032fd0-ae5f-42d4-b88a-2d5da9b070a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:10.650995 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-6f032fd0-ae5f-42d4-b88a-2d5da9b070a5 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 200 len: 1681 microversion: 2.1 time: 0.191052 Aug 24 17:56:10.651555 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 506/1015] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:10 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:10.939573 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4d9bee2c-158f-4183-bfd3-cde03588a9ea tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:10.940215 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4d9bee2c-158f-4183-bfd3-cde03588a9ea tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:10.946758 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4d9bee2c-158f-4183-bfd3-cde03588a9ea tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:10.947250 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4d9bee2c-158f-4183-bfd3-cde03588a9ea tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:10.947691 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4d9bee2c-158f-4183-bfd3-cde03588a9ea tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:10.948390 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4d9bee2c-158f-4183-bfd3-cde03588a9ea tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:10.948951 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4d9bee2c-158f-4183-bfd3-cde03588a9ea tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:10.949443 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4d9bee2c-158f-4183-bfd3-cde03588a9ea tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:11.088074 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-4d9bee2c-158f-4183-bfd3-cde03588a9ea tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:11.097344 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-4d9bee2c-158f-4183-bfd3-cde03588a9ea tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1673 microversion: 2.1 time: 0.161529 Aug 24 17:56:11.100990 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 510/1016] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:10 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:11.672286 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-49d0ec35-3310-4173-a949-ba52b48f9621 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:11.672906 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-49d0ec35-3310-4173-a949-ba52b48f9621 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:11.679515 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49d0ec35-3310-4173-a949-ba52b48f9621 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:11.680012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49d0ec35-3310-4173-a949-ba52b48f9621 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:11.680457 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49d0ec35-3310-4173-a949-ba52b48f9621 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:11.681181 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49d0ec35-3310-4173-a949-ba52b48f9621 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:11.681642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49d0ec35-3310-4173-a949-ba52b48f9621 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:11.682112 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49d0ec35-3310-4173-a949-ba52b48f9621 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:11.824684 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-49d0ec35-3310-4173-a949-ba52b48f9621 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:11.832483 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-49d0ec35-3310-4173-a949-ba52b48f9621 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 200 len: 1681 microversion: 2.1 time: 0.164117 Aug 24 17:56:11.833048 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 507/1017] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:11 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:12.125198 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-251deb84-aa00-42ff-83b7-7a0cd5226717 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:12.130494 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-251deb84-aa00-42ff-83b7-7a0cd5226717 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:12.130622 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:12.140015 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-251deb84-aa00-42ff-83b7-7a0cd5226717 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:12.140885 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-251deb84-aa00-42ff-83b7-7a0cd5226717 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:12.141682 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-251deb84-aa00-42ff-83b7-7a0cd5226717 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:12.143262 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-251deb84-aa00-42ff-83b7-7a0cd5226717 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:12.144104 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-251deb84-aa00-42ff-83b7-7a0cd5226717 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:12.145052 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-251deb84-aa00-42ff-83b7-7a0cd5226717 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:12.320131 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-251deb84-aa00-42ff-83b7-7a0cd5226717 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:12.329629 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-251deb84-aa00-42ff-83b7-7a0cd5226717 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1673 microversion: 2.1 time: 0.212123 Aug 24 17:56:12.338104 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 511/1018] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:12 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1673 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:12.859052 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b7332e53-1c91-4cc8-ae42-576a5de4ac38 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:12.860165 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-b7332e53-1c91-4cc8-ae42-576a5de4ac38 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:12.872570 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b7332e53-1c91-4cc8-ae42-576a5de4ac38 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:12.873445 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b7332e53-1c91-4cc8-ae42-576a5de4ac38 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:12.874279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b7332e53-1c91-4cc8-ae42-576a5de4ac38 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:12.875582 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b7332e53-1c91-4cc8-ae42-576a5de4ac38 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:12.876430 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b7332e53-1c91-4cc8-ae42-576a5de4ac38 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:12.884036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b7332e53-1c91-4cc8-ae42-576a5de4ac38 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:13.229257 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b7332e53-1c91-4cc8-ae42-576a5de4ac38 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:13.239992 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b7332e53-1c91-4cc8-ae42-576a5de4ac38 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 200 len: 1681 microversion: 2.1 time: 0.389031 Aug 24 17:56:13.257279 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 508/1019] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:12 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 1681 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:13.351755 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-8a49b302-9864-4fd0-b751-fdbca48fbd0f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:13.352385 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-8a49b302-9864-4fd0-b751-fdbca48fbd0f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:13.359768 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8a49b302-9864-4fd0-b751-fdbca48fbd0f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:13.360332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8a49b302-9864-4fd0-b751-fdbca48fbd0f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:13.360772 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8a49b302-9864-4fd0-b751-fdbca48fbd0f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:13.362242 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8a49b302-9864-4fd0-b751-fdbca48fbd0f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:13.362891 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8a49b302-9864-4fd0-b751-fdbca48fbd0f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:13.363913 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8a49b302-9864-4fd0-b751-fdbca48fbd0f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:13.473307 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-8a49b302-9864-4fd0-b751-fdbca48fbd0f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:13.486396 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-8a49b302-9864-4fd0-b751-fdbca48fbd0f tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1606 microversion: 2.1 time: 0.138690 Aug 24 17:56:13.501046 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 512/1020] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:13 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1606 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:13.665796 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-ce0a9831-b688-4606-9c35-b638f4fa7779 req-7564f832-9e73-45cf-b13a-d9873d471a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a759f40-8f53-4041-85f4-6f56cdded52b", "name": "network-vif-deleted", "tag": "fd7822b1-ee55-4ee8-b60e-46b6ff456ee9"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:13.679795 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-ce0a9831-b688-4606-9c35-b638f4fa7779 req-7564f832-9e73-45cf-b13a-d9873d471a06 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:13.680517 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-ce0a9831-b688-4606-9c35-b638f4fa7779 req-7564f832-9e73-45cf-b13a-d9873d471a06 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:13.680955 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-ce0a9831-b688-4606-9c35-b638f4fa7779 req-7564f832-9e73-45cf-b13a-d9873d471a06 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:13.694146 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-ce0a9831-b688-4606-9c35-b638f4fa7779 req-7564f832-9e73-45cf-b13a-d9873d471a06 service nova] Creating event network-vif-deleted:fd7822b1-ee55-4ee8-b60e-46b6ff456ee9 for instance 5a759f40-8f53-4041-85f4-6f56cdded52b on hv-cinder-85442 Aug 24 17:56:13.701248 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-ce0a9831-b688-4606-9c35-b638f4fa7779 req-7564f832-9e73-45cf-b13a-d9873d471a06 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039599 Aug 24 17:56:13.702385 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 509/1021] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:14.003987 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-0162b7f7-97b8-4b3c-803c-f29a0c4ee44c req-986163bc-1afc-494e-bd5c-de9af09035ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c778621a-6f96-42dd-926e-a398bb219880", "name": "network-vif-deleted", "tag": "9763e972-34e4-4117-87ff-40626f7974b5"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:14.019936 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-0162b7f7-97b8-4b3c-803c-f29a0c4ee44c req-986163bc-1afc-494e-bd5c-de9af09035ce service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:14.022919 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-0162b7f7-97b8-4b3c-803c-f29a0c4ee44c req-986163bc-1afc-494e-bd5c-de9af09035ce service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:14.023527 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-0162b7f7-97b8-4b3c-803c-f29a0c4ee44c req-986163bc-1afc-494e-bd5c-de9af09035ce service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:14.040375 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-0162b7f7-97b8-4b3c-803c-f29a0c4ee44c req-986163bc-1afc-494e-bd5c-de9af09035ce service nova] Creating event network-vif-deleted:9763e972-34e4-4117-87ff-40626f7974b5 for instance c778621a-6f96-42dd-926e-a398bb219880 on hv-cinder-85442 Aug 24 17:56:14.063871 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-0162b7f7-97b8-4b3c-803c-f29a0c4ee44c req-986163bc-1afc-494e-bd5c-de9af09035ce service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063210 Aug 24 17:56:14.064400 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 513/1022] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:14.264839 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-4fc562e6-afb5-4696-b7a0-7c68591e0ce3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:14.266381 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4fc562e6-afb5-4696-b7a0-7c68591e0ce3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:14.277494 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4fc562e6-afb5-4696-b7a0-7c68591e0ce3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:14.278267 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4fc562e6-afb5-4696-b7a0-7c68591e0ce3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:14.278876 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4fc562e6-afb5-4696-b7a0-7c68591e0ce3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:14.280578 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4fc562e6-afb5-4696-b7a0-7c68591e0ce3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:14.281197 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4fc562e6-afb5-4696-b7a0-7c68591e0ce3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:14.281834 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4fc562e6-afb5-4696-b7a0-7c68591e0ce3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:14.326567 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4fc562e6-afb5-4696-b7a0-7c68591e0ce3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:14.327045 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4fc562e6-afb5-4696-b7a0-7c68591e0ce3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:14.330285 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4fc562e6-afb5-4696-b7a0-7c68591e0ce3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:14.330285 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-4fc562e6-afb5-4696-b7a0-7c68591e0ce3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lazy-loading 'fault' on Instance uuid 5a759f40-8f53-4041-85f4-6f56cdded52b {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:56:14.379691 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-4fc562e6-afb5-4696-b7a0-7c68591e0ce3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '251bc85f89774142a97acd77895b14e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4d7fadea104c569ca29ff9be48089a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:14.391676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-4fc562e6-afb5-4696-b7a0-7c68591e0ce3 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 200 len: 1331 microversion: 2.1 time: 0.133830 Aug 24 17:56:14.392839 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 510/1023] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:14 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 1331 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:14.510438 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-46644cbc-4c41-454a-96eb-c8f82a012697 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:14.511899 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-46644cbc-4c41-454a-96eb-c8f82a012697 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:14.527914 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46644cbc-4c41-454a-96eb-c8f82a012697 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:14.528420 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46644cbc-4c41-454a-96eb-c8f82a012697 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:14.528838 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46644cbc-4c41-454a-96eb-c8f82a012697 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:14.541871 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46644cbc-4c41-454a-96eb-c8f82a012697 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:14.542578 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46644cbc-4c41-454a-96eb-c8f82a012697 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:14.542872 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46644cbc-4c41-454a-96eb-c8f82a012697 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:14.595174 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46644cbc-4c41-454a-96eb-c8f82a012697 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:14.595626 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46644cbc-4c41-454a-96eb-c8f82a012697 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:14.596112 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46644cbc-4c41-454a-96eb-c8f82a012697 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:14.596618 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-46644cbc-4c41-454a-96eb-c8f82a012697 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lazy-loading 'fault' on Instance uuid c778621a-6f96-42dd-926e-a398bb219880 {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:56:14.650432 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-46644cbc-4c41-454a-96eb-c8f82a012697 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6b0d0cbdb54a46a7e9d6936c47cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40256802535d4aedb2541246a687ec76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:14.661508 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-46644cbc-4c41-454a-96eb-c8f82a012697 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 200 len: 1328 microversion: 2.1 time: 0.156262 Aug 24 17:56:14.662556 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 514/1024] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:14 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 1328 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:15.419397 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5f19a623-18a1-4ece-b2ad-df227b808cfd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:15.420023 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5f19a623-18a1-4ece-b2ad-df227b808cfd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:15.426403 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5f19a623-18a1-4ece-b2ad-df227b808cfd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:15.426901 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5f19a623-18a1-4ece-b2ad-df227b808cfd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:15.427336 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5f19a623-18a1-4ece-b2ad-df227b808cfd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:15.428087 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5f19a623-18a1-4ece-b2ad-df227b808cfd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:15.428543 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5f19a623-18a1-4ece-b2ad-df227b808cfd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:15.428975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5f19a623-18a1-4ece-b2ad-df227b808cfd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:15.443496 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-5f19a623-18a1-4ece-b2ad-df227b808cfd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] HTTP exception thrown: Instance 5a759f40-8f53-4041-85f4-6f56cdded52b could not be found. Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5f19a623-18a1-4ece-b2ad-df227b808cfd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Request method failure captured: Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b HTTP/1.1 Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmSbnOSGx7e91Bj6OLQvb6olH3rhtuwbwgCFF2TiEJuGnQyAMTLci2PNua_H1N1Jgo-7CaRuKelcRsW8AHd-7NBHe9Qv1DY7-HELa-jl_G34ACZrF6UPOZU70uNjUu-29pkZxRoJdko5GsGgd7qyf34-jqX4JFHPGtUaryYBDPnp0Vk Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:56:15.445173 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:56:15.447143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0a4d7fadea104c569ca29ff9be48089a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:56:15.447143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:15.447143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:56:15.447143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:15.447143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:56:15.447143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:56:15.447143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:56:15.447143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 251bc85f89774142a97acd77895b14e9 Aug 24 17:56:15.447143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:56:15.447143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:56:15.447143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance 5a759f40-8f53-4041-85f4-6f56cdded52b could not be found. Aug 24 17:56:15.447143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': '5a759f40-8f53-4041-85f4-6f56cdded52b'} Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a759f40-8f53-4041-85f4-6f56cdded52b could not be found. Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:15.448119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:15.450158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:15.450158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:56:15.450158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:56:15.450158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:15.450158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:15.450158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:15.450158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:15.450158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a759f40-8f53-4041-85f4-6f56cdded52b could not be found. Aug 24 17:56:15.450158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:15.450158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:15.450158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:15.450158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:15.450158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:15.450158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:15.450158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:15.450158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:15.450158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a759f40-8f53-4041-85f4-6f56cdded52b could not be found. Aug 24 17:56:15.450158 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:15.451545 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5f19a623-18a1-4ece-b2ad-df227b808cfd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Returning 404 to user: Instance 5a759f40-8f53-4041-85f4-6f56cdded52b could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:15.451545 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5f19a623-18a1-4ece-b2ad-df227b808cfd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 404 len: 111 microversion: 2.1 time: 0.033062 Aug 24 17:56:15.451545 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 511/1025] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:15 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:56:15.457100 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-fdaf423e-7b56-4629-a890-3ef3f741ef97 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '.version_select at 0x7fce7740bd30>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:15.546854 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-fdaf423e-7b56-4629-a890-3ef3f741ef97 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813526352" status: 202 len: 0 microversion: 2.1 time: 0.093835 Aug 24 17:56:15.547494 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 515/1026] 10.222.0.76 () {58 vars in 1221 bytes} [Wed Aug 24 17:56:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813526352 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:56:15.684739 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-2ffe883a-a9df-40d6-9a90-954562755a5a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:15.685366 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-2ffe883a-a9df-40d6-9a90-954562755a5a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:15.695639 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2ffe883a-a9df-40d6-9a90-954562755a5a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:15.696203 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2ffe883a-a9df-40d6-9a90-954562755a5a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:15.696651 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2ffe883a-a9df-40d6-9a90-954562755a5a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:15.697395 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2ffe883a-a9df-40d6-9a90-954562755a5a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:15.697991 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2ffe883a-a9df-40d6-9a90-954562755a5a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:15.710113 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2ffe883a-a9df-40d6-9a90-954562755a5a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:15.727372 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-2ffe883a-a9df-40d6-9a90-954562755a5a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] HTTP exception thrown: Instance c778621a-6f96-42dd-926e-a398bb219880 could not be found. Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-2ffe883a-a9df-40d6-9a90-954562755a5a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Request method failure captured: Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 HTTP/1.1 Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmShO0WCIT-ieTC0TkC22s2NgbPlbfYeqpu6ROdq8R33p7FSdk6nRhMJ93KK-8IHs5QOrFvm_sEVfOUeogXN52RInGKn0Kxp-2OpFT2Jgz_XZ06W7SW8L7lfFPi06ojVje3oQHlU_gM4OkbLVA2s3lIWcHbQTzatflVFkFwfj3nFjlg Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 40256802535d4aedb2541246a687ec76 Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-AttachVolumeTestJSON-66162385 Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:56:15.729081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:56:15.730785 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/40256802535d4aedb2541246a687ec76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/40256802535d4aedb2541246a687ec76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_40256802535d4aedb2541246a687ec76", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/40256802535d4aedb2541246a687ec76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:56:15.730785 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-AttachVolumeTestJSON-66162385 Aug 24 17:56:15.730785 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 40256802535d4aedb2541246a687ec76 Aug 24 17:56:15.730785 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-AttachVolumeTestJSON-66162385 Aug 24 17:56:15.730785 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-AttachVolumeTestJSON-66162385-project Aug 24 17:56:15.730785 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:56:15.730785 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:56:15.730785 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 2b6b0d0cbdb54a46a7e9d6936c47cc4c Aug 24 17:56:15.730785 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-AttachVolumeTestJSON-66162385-project Aug 24 17:56:15.730785 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:56:15.730785 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance c778621a-6f96-42dd-926e-a398bb219880 could not be found. Aug 24 17:56:15.730785 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': 'c778621a-6f96-42dd-926e-a398bb219880'} Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c778621a-6f96-42dd-926e-a398bb219880 could not be found. Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:15.731640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:15.733060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:15.733060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:56:15.733060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:56:15.733060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:15.733060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:15.733060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:15.733060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:15.733060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c778621a-6f96-42dd-926e-a398bb219880 could not be found. Aug 24 17:56:15.733060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:15.733060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:15.733060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:15.733060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:15.733060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:15.733060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:15.733060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:15.733060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:15.733060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c778621a-6f96-42dd-926e-a398bb219880 could not be found. Aug 24 17:56:15.733060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:15.734406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-2ffe883a-a9df-40d6-9a90-954562755a5a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Returning 404 to user: Instance c778621a-6f96-42dd-926e-a398bb219880 could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:15.734406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-2ffe883a-a9df-40d6-9a90-954562755a5a tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 404 len: 111 microversion: 2.1 time: 0.049867 Aug 24 17:56:15.734406 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 512/1027] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:15 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:56:15.740216 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-778330ac-33fe-4570-a299-8bf55379b6f2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '.version_select at 0x7fce772ad670>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:15.841254 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-778330ac-33fe-4570-a299-8bf55379b6f2 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152614609" status: 202 len: 0 microversion: 2.1 time: 0.104954 Aug 24 17:56:15.844832 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 516/1028] 10.222.0.76 () {58 vars in 1221 bytes} [Wed Aug 24 17:56:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152614609 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:56:18.049322 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-cb5be0a5-ef8f-4c44-9c23-f871d989d8fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:18.049914 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-cb5be0a5-ef8f-4c44-9c23-f871d989d8fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:18.056790 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cb5be0a5-ef8f-4c44-9c23-f871d989d8fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:18.057318 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cb5be0a5-ef8f-4c44-9c23-f871d989d8fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:18.057784 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cb5be0a5-ef8f-4c44-9c23-f871d989d8fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:18.060584 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cb5be0a5-ef8f-4c44-9c23-f871d989d8fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:18.061032 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cb5be0a5-ef8f-4c44-9c23-f871d989d8fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:18.061466 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cb5be0a5-ef8f-4c44-9c23-f871d989d8fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:18.077754 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-cb5be0a5-ef8f-4c44-9c23-f871d989d8fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] HTTP exception thrown: Instance 5a759f40-8f53-4041-85f4-6f56cdded52b could not be found. Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-cb5be0a5-ef8f-4c44-9c23-f871d989d8fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Request method failure captured: Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: DELETE /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b HTTP/1.1 Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmSbnOSGx7e91Bj6OLQvb6olH3rhtuwbwgCFF2TiEJuGnQyAMTLci2PNua_H1N1Jgo-7CaRuKelcRsW8AHd-7NBHe9Qv1DY7-HELa-jl_G34ACZrF6UPOZU70uNjUu-29pkZxRoJdko5GsGgd7qyf34-jqX4JFHPGtUaryYBDPnp0Vk Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:56:18.079347 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:56:18.080949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0a4d7fadea104c569ca29ff9be48089a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:56:18.080949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:18.080949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:56:18.080949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:18.080949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:56:18.080949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:56:18.080949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:56:18.080949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 251bc85f89774142a97acd77895b14e9 Aug 24 17:56:18.080949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:56:18.080949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:56:18.080949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance 5a759f40-8f53-4041-85f4-6f56cdded52b could not be found. Aug 24 17:56:18.080949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': '5a759f40-8f53-4041-85f4-6f56cdded52b'} Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a759f40-8f53-4041-85f4-6f56cdded52b could not be found. Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:18.082012 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a759f40-8f53-4041-85f4-6f56cdded52b could not be found. Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a759f40-8f53-4041-85f4-6f56cdded52b could not be found. Aug 24 17:56:18.083656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:18.085685 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-cb5be0a5-ef8f-4c44-9c23-f871d989d8fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Returning 404 to user: Instance 5a759f40-8f53-4041-85f4-6f56cdded52b could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:18.085685 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-cb5be0a5-ef8f-4c44-9c23-f871d989d8fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 404 len: 111 microversion: 2.1 time: 0.036034 Aug 24 17:56:18.085685 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 513/1029] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:56:18 2022] DELETE /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:56:18.092294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e190a214-c8b0-4226-982c-6fd78a4b57df tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:18.097426 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-e190a214-c8b0-4226-982c-6fd78a4b57df tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 5a759f40-8f53-4041-85f4-6f56cdded52b] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:18.101200 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e190a214-c8b0-4226-982c-6fd78a4b57df tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:18.101943 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e190a214-c8b0-4226-982c-6fd78a4b57df tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:18.102408 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e190a214-c8b0-4226-982c-6fd78a4b57df tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:18.103146 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e190a214-c8b0-4226-982c-6fd78a4b57df tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:18.103606 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e190a214-c8b0-4226-982c-6fd78a4b57df tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:18.104031 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e190a214-c8b0-4226-982c-6fd78a4b57df tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:18.119546 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-e190a214-c8b0-4226-982c-6fd78a4b57df tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] HTTP exception thrown: Instance 5a759f40-8f53-4041-85f4-6f56cdded52b could not be found. Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e190a214-c8b0-4226-982c-6fd78a4b57df tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Request method failure captured: Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b HTTP/1.1 Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmSbnOSGx7e91Bj6OLQvb6olH3rhtuwbwgCFF2TiEJuGnQyAMTLci2PNua_H1N1Jgo-7CaRuKelcRsW8AHd-7NBHe9Qv1DY7-HELa-jl_G34ACZrF6UPOZU70uNjUu-29pkZxRoJdko5GsGgd7qyf34-jqX4JFHPGtUaryYBDPnp0Vk Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:56:18.122166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:56:18.123563 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0a4d7fadea104c569ca29ff9be48089a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:56:18.123563 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:18.123563 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:56:18.123563 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:18.123563 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:56:18.123563 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:56:18.123563 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:56:18.123563 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: 251bc85f89774142a97acd77895b14e9 Aug 24 17:56:18.123563 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:56:18.123563 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:56:18.123563 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance 5a759f40-8f53-4041-85f4-6f56cdded52b could not be found. Aug 24 17:56:18.123563 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': '5a759f40-8f53-4041-85f4-6f56cdded52b'} Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a759f40-8f53-4041-85f4-6f56cdded52b could not be found. Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:18.124417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:18.125647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:18.125647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:56:18.125647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:56:18.125647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:18.125647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:18.125647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:18.125647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:18.125647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a759f40-8f53-4041-85f4-6f56cdded52b could not be found. Aug 24 17:56:18.125647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:18.125647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:18.125647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:18.125647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:18.125647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:18.125647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:18.125647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:18.125647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:18.125647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a759f40-8f53-4041-85f4-6f56cdded52b could not be found. Aug 24 17:56:18.125647 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:18.132464 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e190a214-c8b0-4226-982c-6fd78a4b57df tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Returning 404 to user: Instance 5a759f40-8f53-4041-85f4-6f56cdded52b could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:18.132464 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-e190a214-c8b0-4226-982c-6fd78a4b57df tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b" status: 404 len: 111 microversion: 2.1 time: 0.036221 Aug 24 17:56:18.132464 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 517/1030] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:18 2022] GET /compute/v2.1/servers/5a759f40-8f53-4041-85f4-6f56cdded52b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:56:19.431692 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8f8f5473-3d48-474e-bc65-3af8eeca6ea6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:19.432264 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8f8f5473-3d48-474e-bc65-3af8eeca6ea6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:19.440228 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8f8f5473-3d48-474e-bc65-3af8eeca6ea6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:19.440713 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8f8f5473-3d48-474e-bc65-3af8eeca6ea6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:19.441152 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8f8f5473-3d48-474e-bc65-3af8eeca6ea6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:19.441896 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8f8f5473-3d48-474e-bc65-3af8eeca6ea6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:19.442422 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8f8f5473-3d48-474e-bc65-3af8eeca6ea6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:19.442846 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8f8f5473-3d48-474e-bc65-3af8eeca6ea6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:19.456578 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-8f8f5473-3d48-474e-bc65-3af8eeca6ea6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] HTTP exception thrown: Instance ea4c5b83-10ba-4343-a209-f00a509aa20f could not be found. Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8f8f5473-3d48-474e-bc65-3af8eeca6ea6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Request method failure captured: Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: DELETE /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f HTTP/1.1 Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmSbnOSGx7e91Bj6OLQvb6olH3rhtuwbwgCFF2TiEJuGnQyAMTLci2PNua_H1N1Jgo-7CaRuKelcRsW8AHd-7NBHe9Qv1DY7-HELa-jl_G34ACZrF6UPOZU70uNjUu-29pkZxRoJdko5GsGgd7qyf34-jqX4JFHPGtUaryYBDPnp0Vk Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:56:19.458222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:56:19.465364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0a4d7fadea104c569ca29ff9be48089a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:56:19.465364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:19.465364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:56:19.465364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:19.465364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:56:19.465364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:56:19.465364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:56:19.465364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 251bc85f89774142a97acd77895b14e9 Aug 24 17:56:19.465364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:56:19.465364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:56:19.465364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance ea4c5b83-10ba-4343-a209-f00a509aa20f could not be found. Aug 24 17:56:19.465364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': 'ea4c5b83-10ba-4343-a209-f00a509aa20f'} Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4c5b83-10ba-4343-a209-f00a509aa20f could not be found. Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:19.466283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4c5b83-10ba-4343-a209-f00a509aa20f could not be found. Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4c5b83-10ba-4343-a209-f00a509aa20f could not be found. Aug 24 17:56:19.467675 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.469089 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8f8f5473-3d48-474e-bc65-3af8eeca6ea6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Returning 404 to user: Instance ea4c5b83-10ba-4343-a209-f00a509aa20f could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:19.469089 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-8f8f5473-3d48-474e-bc65-3af8eeca6ea6 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 404 len: 111 microversion: 2.1 time: 0.031904 Aug 24 17:56:19.469089 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 514/1031] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:56:19 2022] DELETE /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:56:19.469322 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d5586f3a-1670-4b47-af10-90d419eaa1fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:19.469752 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d5586f3a-1670-4b47-af10-90d419eaa1fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: ea4c5b83-10ba-4343-a209-f00a509aa20f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:19.475856 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d5586f3a-1670-4b47-af10-90d419eaa1fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:19.476381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d5586f3a-1670-4b47-af10-90d419eaa1fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:19.476814 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d5586f3a-1670-4b47-af10-90d419eaa1fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:19.477491 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d5586f3a-1670-4b47-af10-90d419eaa1fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:19.477976 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d5586f3a-1670-4b47-af10-90d419eaa1fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:19.478398 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-d5586f3a-1670-4b47-af10-90d419eaa1fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:19.493114 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-d5586f3a-1670-4b47-af10-90d419eaa1fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] HTTP exception thrown: Instance ea4c5b83-10ba-4343-a209-f00a509aa20f could not be found. Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d5586f3a-1670-4b47-af10-90d419eaa1fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Request method failure captured: Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f HTTP/1.1 Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmSbnOSGx7e91Bj6OLQvb6olH3rhtuwbwgCFF2TiEJuGnQyAMTLci2PNua_H1N1Jgo-7CaRuKelcRsW8AHd-7NBHe9Qv1DY7-HELa-jl_G34ACZrF6UPOZU70uNjUu-29pkZxRoJdko5GsGgd7qyf34-jqX4JFHPGtUaryYBDPnp0Vk Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:56:19.494701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:56:19.496986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0a4d7fadea104c569ca29ff9be48089a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:56:19.496986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:19.496986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:56:19.496986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:19.496986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:56:19.496986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:56:19.496986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:56:19.496986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: 251bc85f89774142a97acd77895b14e9 Aug 24 17:56:19.496986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:56:19.496986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:56:19.496986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance ea4c5b83-10ba-4343-a209-f00a509aa20f could not be found. Aug 24 17:56:19.496986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': 'ea4c5b83-10ba-4343-a209-f00a509aa20f'} Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4c5b83-10ba-4343-a209-f00a509aa20f could not be found. Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:19.497952 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:19.499565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:19.499565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:56:19.499565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:56:19.499565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:19.499565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:19.499565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:19.499565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:19.499565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4c5b83-10ba-4343-a209-f00a509aa20f could not be found. Aug 24 17:56:19.499565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.499565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:19.499565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.499565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:19.499565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:19.499565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:19.499565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:19.499565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:19.499565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4c5b83-10ba-4343-a209-f00a509aa20f could not be found. Aug 24 17:56:19.499565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.500949 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d5586f3a-1670-4b47-af10-90d419eaa1fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Returning 404 to user: Instance ea4c5b83-10ba-4343-a209-f00a509aa20f could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:19.500949 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d5586f3a-1670-4b47-af10-90d419eaa1fa tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f" status: 404 len: 111 microversion: 2.1 time: 0.032371 Aug 24 17:56:19.500949 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 518/1032] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:19 2022] GET /compute/v2.1/servers/ea4c5b83-10ba-4343-a209-f00a509aa20f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:56:19.506044 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-85fd12fd-6dbd-4d22-a0e7-8f82fc23190b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:19.506551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-85fd12fd-6dbd-4d22-a0e7-8f82fc23190b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:19.512726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-85fd12fd-6dbd-4d22-a0e7-8f82fc23190b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:19.513214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-85fd12fd-6dbd-4d22-a0e7-8f82fc23190b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:19.513652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-85fd12fd-6dbd-4d22-a0e7-8f82fc23190b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:19.514384 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-85fd12fd-6dbd-4d22-a0e7-8f82fc23190b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:19.514845 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-85fd12fd-6dbd-4d22-a0e7-8f82fc23190b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:19.515276 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-85fd12fd-6dbd-4d22-a0e7-8f82fc23190b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:19.529659 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-85fd12fd-6dbd-4d22-a0e7-8f82fc23190b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] HTTP exception thrown: Instance e96b5e63-7140-4b8b-99e9-005627134785 could not be found. Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-85fd12fd-6dbd-4d22-a0e7-8f82fc23190b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Request method failure captured: Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: DELETE /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 HTTP/1.1 Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmSbnOSGx7e91Bj6OLQvb6olH3rhtuwbwgCFF2TiEJuGnQyAMTLci2PNua_H1N1Jgo-7CaRuKelcRsW8AHd-7NBHe9Qv1DY7-HELa-jl_G34ACZrF6UPOZU70uNjUu-29pkZxRoJdko5GsGgd7qyf34-jqX4JFHPGtUaryYBDPnp0Vk Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:56:19.531266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:56:19.532985 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0a4d7fadea104c569ca29ff9be48089a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:56:19.532985 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:19.532985 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:56:19.532985 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:19.532985 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:56:19.532985 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:56:19.532985 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:56:19.532985 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 251bc85f89774142a97acd77895b14e9 Aug 24 17:56:19.532985 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:56:19.532985 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:56:19.532985 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance e96b5e63-7140-4b8b-99e9-005627134785 could not be found. Aug 24 17:56:19.532985 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': 'e96b5e63-7140-4b8b-99e9-005627134785'} Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e96b5e63-7140-4b8b-99e9-005627134785 could not be found. Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:19.533788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e96b5e63-7140-4b8b-99e9-005627134785 could not be found. Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e96b5e63-7140-4b8b-99e9-005627134785 could not be found. Aug 24 17:56:19.535311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.537060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-85fd12fd-6dbd-4d22-a0e7-8f82fc23190b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Returning 404 to user: Instance e96b5e63-7140-4b8b-99e9-005627134785 could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:19.537060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-85fd12fd-6dbd-4d22-a0e7-8f82fc23190b tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 404 len: 111 microversion: 2.1 time: 0.030664 Aug 24 17:56:19.537060 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 515/1033] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:56:19 2022] DELETE /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:56:19.545775 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f79980f0-25b3-4052-8ec5-c3b2b7165efd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:19.546763 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-f79980f0-25b3-4052-8ec5-c3b2b7165efd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: e96b5e63-7140-4b8b-99e9-005627134785] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:19.555373 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f79980f0-25b3-4052-8ec5-c3b2b7165efd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:19.556136 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f79980f0-25b3-4052-8ec5-c3b2b7165efd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:19.556665 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f79980f0-25b3-4052-8ec5-c3b2b7165efd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:19.558715 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f79980f0-25b3-4052-8ec5-c3b2b7165efd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:19.559198 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f79980f0-25b3-4052-8ec5-c3b2b7165efd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:19.559641 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f79980f0-25b3-4052-8ec5-c3b2b7165efd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:19.578000 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-f79980f0-25b3-4052-8ec5-c3b2b7165efd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] HTTP exception thrown: Instance e96b5e63-7140-4b8b-99e9-005627134785 could not be found. Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f79980f0-25b3-4052-8ec5-c3b2b7165efd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Request method failure captured: Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 HTTP/1.1 Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmSbnOSGx7e91Bj6OLQvb6olH3rhtuwbwgCFF2TiEJuGnQyAMTLci2PNua_H1N1Jgo-7CaRuKelcRsW8AHd-7NBHe9Qv1DY7-HELa-jl_G34ACZrF6UPOZU70uNjUu-29pkZxRoJdko5GsGgd7qyf34-jqX4JFHPGtUaryYBDPnp0Vk Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:56:19.579697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:56:19.581179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0a4d7fadea104c569ca29ff9be48089a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:56:19.581179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:19.581179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:56:19.581179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:19.581179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:56:19.581179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:56:19.581179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:56:19.581179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: 251bc85f89774142a97acd77895b14e9 Aug 24 17:56:19.581179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:56:19.581179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:56:19.581179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance e96b5e63-7140-4b8b-99e9-005627134785 could not be found. Aug 24 17:56:19.581179 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': 'e96b5e63-7140-4b8b-99e9-005627134785'} Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e96b5e63-7140-4b8b-99e9-005627134785 could not be found. Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:19.582106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:19.583468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:19.583468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:56:19.583468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:56:19.583468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:19.583468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:19.583468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:19.583468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:19.583468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e96b5e63-7140-4b8b-99e9-005627134785 could not be found. Aug 24 17:56:19.583468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.583468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:19.583468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.583468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:19.583468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:19.583468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:19.583468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:19.583468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:19.583468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e96b5e63-7140-4b8b-99e9-005627134785 could not be found. Aug 24 17:56:19.583468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.584638 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f79980f0-25b3-4052-8ec5-c3b2b7165efd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Returning 404 to user: Instance e96b5e63-7140-4b8b-99e9-005627134785 could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:19.584638 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-f79980f0-25b3-4052-8ec5-c3b2b7165efd tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785" status: 404 len: 111 microversion: 2.1 time: 0.041871 Aug 24 17:56:19.584638 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 519/1034] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:19 2022] GET /compute/v2.1/servers/e96b5e63-7140-4b8b-99e9-005627134785 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:56:19.663888 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-66767ef0-f460-45fe-8285-5e1a8f54f3a4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:19.664390 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-66767ef0-f460-45fe-8285-5e1a8f54f3a4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:19.671275 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-66767ef0-f460-45fe-8285-5e1a8f54f3a4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:19.671761 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-66767ef0-f460-45fe-8285-5e1a8f54f3a4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:19.672197 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-66767ef0-f460-45fe-8285-5e1a8f54f3a4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:19.672904 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-66767ef0-f460-45fe-8285-5e1a8f54f3a4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:19.673387 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-66767ef0-f460-45fe-8285-5e1a8f54f3a4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:19.674035 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-66767ef0-f460-45fe-8285-5e1a8f54f3a4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:19.676911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:19.696900 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-66767ef0-f460-45fe-8285-5e1a8f54f3a4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] HTTP exception thrown: Instance c778621a-6f96-42dd-926e-a398bb219880 could not be found. Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-66767ef0-f460-45fe-8285-5e1a8f54f3a4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Request method failure captured: Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: DELETE /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 HTTP/1.1 Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmShO0WCIT-ieTC0TkC22s2NgbPlbfYeqpu6ROdq8R33p7FSdk6nRhMJ93KK-8IHs5QOrFvm_sEVfOUeogXN52RInGKn0Kxp-2OpFT2Jgz_XZ06W7SW8L7lfFPi06ojVje3oQHlU_gM4OkbLVA2s3lIWcHbQTzatflVFkFwfj3nFjlg Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 40256802535d4aedb2541246a687ec76 Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-AttachVolumeTestJSON-66162385 Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:56:19.698913 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:56:19.700650 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/40256802535d4aedb2541246a687ec76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/40256802535d4aedb2541246a687ec76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_40256802535d4aedb2541246a687ec76", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/40256802535d4aedb2541246a687ec76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:56:19.700650 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-AttachVolumeTestJSON-66162385 Aug 24 17:56:19.700650 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 40256802535d4aedb2541246a687ec76 Aug 24 17:56:19.700650 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-AttachVolumeTestJSON-66162385 Aug 24 17:56:19.700650 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-AttachVolumeTestJSON-66162385-project Aug 24 17:56:19.700650 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:56:19.700650 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:56:19.700650 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 2b6b0d0cbdb54a46a7e9d6936c47cc4c Aug 24 17:56:19.700650 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-AttachVolumeTestJSON-66162385-project Aug 24 17:56:19.700650 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:56:19.700650 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance c778621a-6f96-42dd-926e-a398bb219880 could not be found. Aug 24 17:56:19.700650 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': 'c778621a-6f96-42dd-926e-a398bb219880'} Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c778621a-6f96-42dd-926e-a398bb219880 could not be found. Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:19.701450 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c778621a-6f96-42dd-926e-a398bb219880 could not be found. Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c778621a-6f96-42dd-926e-a398bb219880 could not be found. Aug 24 17:56:19.702922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.704573 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-66767ef0-f460-45fe-8285-5e1a8f54f3a4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Returning 404 to user: Instance c778621a-6f96-42dd-926e-a398bb219880 could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:19.704573 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-66767ef0-f460-45fe-8285-5e1a8f54f3a4 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 404 len: 111 microversion: 2.1 time: 0.040396 Aug 24 17:56:19.704573 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 516/1035] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:56:19 2022] DELETE /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:56:19.710296 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c3e48867-94ae-4cbf-93fd-52b092411b22 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:19.710912 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c3e48867-94ae-4cbf-93fd-52b092411b22 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: c778621a-6f96-42dd-926e-a398bb219880] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:19.718031 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c3e48867-94ae-4cbf-93fd-52b092411b22 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:19.718443 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c3e48867-94ae-4cbf-93fd-52b092411b22 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:19.718884 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c3e48867-94ae-4cbf-93fd-52b092411b22 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:19.719702 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c3e48867-94ae-4cbf-93fd-52b092411b22 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:19.720163 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c3e48867-94ae-4cbf-93fd-52b092411b22 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:19.720596 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c3e48867-94ae-4cbf-93fd-52b092411b22 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:19.736187 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-c3e48867-94ae-4cbf-93fd-52b092411b22 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] HTTP exception thrown: Instance c778621a-6f96-42dd-926e-a398bb219880 could not be found. Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c3e48867-94ae-4cbf-93fd-52b092411b22 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Request method failure captured: Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 HTTP/1.1 Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmShO0WCIT-ieTC0TkC22s2NgbPlbfYeqpu6ROdq8R33p7FSdk6nRhMJ93KK-8IHs5QOrFvm_sEVfOUeogXN52RInGKn0Kxp-2OpFT2Jgz_XZ06W7SW8L7lfFPi06ojVje3oQHlU_gM4OkbLVA2s3lIWcHbQTzatflVFkFwfj3nFjlg Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 40256802535d4aedb2541246a687ec76 Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-AttachVolumeTestJSON-66162385 Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:56:19.737988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:56:19.739559 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/40256802535d4aedb2541246a687ec76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/40256802535d4aedb2541246a687ec76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_40256802535d4aedb2541246a687ec76", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/40256802535d4aedb2541246a687ec76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:56:19.739559 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-AttachVolumeTestJSON-66162385 Aug 24 17:56:19.739559 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 40256802535d4aedb2541246a687ec76 Aug 24 17:56:19.739559 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-AttachVolumeTestJSON-66162385 Aug 24 17:56:19.739559 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-AttachVolumeTestJSON-66162385-project Aug 24 17:56:19.739559 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:56:19.739559 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:56:19.739559 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: 2b6b0d0cbdb54a46a7e9d6936c47cc4c Aug 24 17:56:19.739559 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-AttachVolumeTestJSON-66162385-project Aug 24 17:56:19.739559 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:56:19.739559 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance c778621a-6f96-42dd-926e-a398bb219880 could not be found. Aug 24 17:56:19.739559 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': 'c778621a-6f96-42dd-926e-a398bb219880'} Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c778621a-6f96-42dd-926e-a398bb219880 could not be found. Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:19.740349 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:19.741521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:19.741521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:56:19.741521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:56:19.741521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:19.741521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:19.741521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:19.741521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:19.741521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c778621a-6f96-42dd-926e-a398bb219880 could not be found. Aug 24 17:56:19.741521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.741521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:19.741521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.741521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:19.741521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:19.741521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:19.741521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:19.741521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:19.741521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c778621a-6f96-42dd-926e-a398bb219880 could not be found. Aug 24 17:56:19.741521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:19.742727 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c3e48867-94ae-4cbf-93fd-52b092411b22 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Returning 404 to user: Instance c778621a-6f96-42dd-926e-a398bb219880 could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:19.742727 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c3e48867-94ae-4cbf-93fd-52b092411b22 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880" status: 404 len: 111 microversion: 2.1 time: 0.033800 Aug 24 17:56:19.742727 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 520/1036] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:19 2022] GET /compute/v2.1/servers/c778621a-6f96-42dd-926e-a398bb219880 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:56:20.935662 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5bb6e901-18da-4534-8854-6a35d635ec98 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:20.936183 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5bb6e901-18da-4534-8854-6a35d635ec98 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:20.943210 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5bb6e901-18da-4534-8854-6a35d635ec98 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:20.943699 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5bb6e901-18da-4534-8854-6a35d635ec98 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:20.944192 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5bb6e901-18da-4534-8854-6a35d635ec98 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:20.944966 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5bb6e901-18da-4534-8854-6a35d635ec98 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:20.945423 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5bb6e901-18da-4534-8854-6a35d635ec98 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:20.945865 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5bb6e901-18da-4534-8854-6a35d635ec98 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:20.960958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-5bb6e901-18da-4534-8854-6a35d635ec98 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] HTTP exception thrown: Instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 could not be found. Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5bb6e901-18da-4534-8854-6a35d635ec98 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Request method failure captured: Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: DELETE /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 HTTP/1.1 Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmSbnOSGx7e91Bj6OLQvb6olH3rhtuwbwgCFF2TiEJuGnQyAMTLci2PNua_H1N1Jgo-7CaRuKelcRsW8AHd-7NBHe9Qv1DY7-HELa-jl_G34ACZrF6UPOZU70uNjUu-29pkZxRoJdko5GsGgd7qyf34-jqX4JFHPGtUaryYBDPnp0Vk Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:56:20.962733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:56:20.970389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0a4d7fadea104c569ca29ff9be48089a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:56:20.970389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:20.970389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:56:20.970389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:20.970389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:56:20.970389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:56:20.970389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:56:20.970389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 251bc85f89774142a97acd77895b14e9 Aug 24 17:56:20.970389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:56:20.970389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:56:20.970389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 could not be found. Aug 24 17:56:20.970389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': '8cd743b2-3b6c-4213-819a-1a25314ed5e2'} Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 could not be found. Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:20.971748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 could not be found. Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 could not be found. Aug 24 17:56:20.973255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:20.974732 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5bb6e901-18da-4534-8854-6a35d635ec98 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Returning 404 to user: Instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:20.974732 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5bb6e901-18da-4534-8854-6a35d635ec98 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "DELETE /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 404 len: 111 microversion: 2.1 time: 0.033791 Aug 24 17:56:20.974732 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 517/1037] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:56:20 2022] DELETE /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:56:20.980357 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-aef75044-f5b1-4d3a-9377-633d12db0f19 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:20.981052 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-aef75044-f5b1-4d3a-9377-633d12db0f19 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] [instance: 8cd743b2-3b6c-4213-819a-1a25314ed5e2] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:20.988288 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-aef75044-f5b1-4d3a-9377-633d12db0f19 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:20.989905 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-aef75044-f5b1-4d3a-9377-633d12db0f19 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:20.989905 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-aef75044-f5b1-4d3a-9377-633d12db0f19 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:20.989905 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-aef75044-f5b1-4d3a-9377-633d12db0f19 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:20.990529 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-aef75044-f5b1-4d3a-9377-633d12db0f19 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:20.990920 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-aef75044-f5b1-4d3a-9377-633d12db0f19 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:21.006725 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-aef75044-f5b1-4d3a-9377-633d12db0f19 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] HTTP exception thrown: Instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 could not be found. Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-aef75044-f5b1-4d3a-9377-633d12db0f19 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Request method failure captured: Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 HTTP/1.1 Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmSbnOSGx7e91Bj6OLQvb6olH3rhtuwbwgCFF2TiEJuGnQyAMTLci2PNua_H1N1Jgo-7CaRuKelcRsW8AHd-7NBHe9Qv1DY7-HELa-jl_G34ACZrF6UPOZU70uNjUu-29pkZxRoJdko5GsGgd7qyf34-jqX4JFHPGtUaryYBDPnp0Vk Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:56:21.008332 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:56:21.010303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_0a4d7fadea104c569ca29ff9be48089a", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/0a4d7fadea104c569ca29ff9be48089a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:56:21.010303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:21.010303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 0a4d7fadea104c569ca29ff9be48089a Aug 24 17:56:21.010303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780487869 Aug 24 17:56:21.010303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:56:21.010303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:56:21.010303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:56:21.010303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: 251bc85f89774142a97acd77895b14e9 Aug 24 17:56:21.010303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-AttachVolumeNegativeTest-780487869-project Aug 24 17:56:21.010303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:56:21.010303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 could not be found. Aug 24 17:56:21.010303 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': '8cd743b2-3b6c-4213-819a-1a25314ed5e2'} Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 could not be found. Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:21.012480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:21.014693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:21.014693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:56:21.014693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:56:21.014693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:21.014693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:21.014693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:21.014693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:21.014693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 could not be found. Aug 24 17:56:21.014693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:21.014693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:21.014693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:21.014693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:21.014693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:21.014693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:21.014693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:21.014693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:21.014693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 could not be found. Aug 24 17:56:21.014693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:21.016649 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-aef75044-f5b1-4d3a-9377-633d12db0f19 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] Returning 404 to user: Instance 8cd743b2-3b6c-4213-819a-1a25314ed5e2 could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:21.016649 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-aef75044-f5b1-4d3a-9377-633d12db0f19 tempest-AttachVolumeNegativeTest-780487869 tempest-AttachVolumeNegativeTest-780487869-project] 10.222.0.76 "GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2" status: 404 len: 111 microversion: 2.1 time: 0.033517 Aug 24 17:56:21.019353 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 521/1038] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:20 2022] GET /compute/v2.1/servers/8cd743b2-3b6c-4213-819a-1a25314ed5e2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:56:21.128254 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-037153dc-9014-4ad5-8f3f-6e42d99f052d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:21.128761 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-037153dc-9014-4ad5-8f3f-6e42d99f052d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:21.135657 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-037153dc-9014-4ad5-8f3f-6e42d99f052d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:21.136157 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-037153dc-9014-4ad5-8f3f-6e42d99f052d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:21.136608 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-037153dc-9014-4ad5-8f3f-6e42d99f052d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:21.137314 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-037153dc-9014-4ad5-8f3f-6e42d99f052d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:21.137777 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-037153dc-9014-4ad5-8f3f-6e42d99f052d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:21.138251 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-037153dc-9014-4ad5-8f3f-6e42d99f052d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:21.153439 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-037153dc-9014-4ad5-8f3f-6e42d99f052d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] HTTP exception thrown: Instance ec9a988c-b152-4e39-ad48-c2f7facd203f could not be found. Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-037153dc-9014-4ad5-8f3f-6e42d99f052d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Request method failure captured: Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: DELETE /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f HTTP/1.1 Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmShO0WCIT-ieTC0TkC22s2NgbPlbfYeqpu6ROdq8R33p7FSdk6nRhMJ93KK-8IHs5QOrFvm_sEVfOUeogXN52RInGKn0Kxp-2OpFT2Jgz_XZ06W7SW8L7lfFPi06ojVje3oQHlU_gM4OkbLVA2s3lIWcHbQTzatflVFkFwfj3nFjlg Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 40256802535d4aedb2541246a687ec76 Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-AttachVolumeTestJSON-66162385 Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:56:21.154911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:56:21.156570 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/40256802535d4aedb2541246a687ec76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/40256802535d4aedb2541246a687ec76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_40256802535d4aedb2541246a687ec76", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/40256802535d4aedb2541246a687ec76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:56:21.156570 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-AttachVolumeTestJSON-66162385 Aug 24 17:56:21.156570 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 40256802535d4aedb2541246a687ec76 Aug 24 17:56:21.156570 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-AttachVolumeTestJSON-66162385 Aug 24 17:56:21.156570 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-AttachVolumeTestJSON-66162385-project Aug 24 17:56:21.156570 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:56:21.156570 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:56:21.156570 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 2b6b0d0cbdb54a46a7e9d6936c47cc4c Aug 24 17:56:21.156570 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-AttachVolumeTestJSON-66162385-project Aug 24 17:56:21.156570 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:56:21.156570 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance ec9a988c-b152-4e39-ad48-c2f7facd203f could not be found. Aug 24 17:56:21.156570 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': 'ec9a988c-b152-4e39-ad48-c2f7facd203f'} Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec9a988c-b152-4e39-ad48-c2f7facd203f could not be found. Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:21.157344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec9a988c-b152-4e39-ad48-c2f7facd203f could not be found. Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec9a988c-b152-4e39-ad48-c2f7facd203f could not be found. Aug 24 17:56:21.158595 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:21.159823 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-037153dc-9014-4ad5-8f3f-6e42d99f052d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Returning 404 to user: Instance ec9a988c-b152-4e39-ad48-c2f7facd203f could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:21.159823 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-037153dc-9014-4ad5-8f3f-6e42d99f052d tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 404 len: 111 microversion: 2.1 time: 0.032618 Aug 24 17:56:21.159823 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 518/1039] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:56:21 2022] DELETE /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:56:21.164951 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a298ff30-3a1d-4c22-8375-d9b5f4e0f166 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:21.166107 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a298ff30-3a1d-4c22-8375-d9b5f4e0f166 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] [instance: ec9a988c-b152-4e39-ad48-c2f7facd203f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:21.172800 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a298ff30-3a1d-4c22-8375-d9b5f4e0f166 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:21.173288 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a298ff30-3a1d-4c22-8375-d9b5f4e0f166 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:21.173762 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a298ff30-3a1d-4c22-8375-d9b5f4e0f166 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:21.174460 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a298ff30-3a1d-4c22-8375-d9b5f4e0f166 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:21.174923 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a298ff30-3a1d-4c22-8375-d9b5f4e0f166 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:21.175353 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a298ff30-3a1d-4c22-8375-d9b5f4e0f166 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:21.190329 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-a298ff30-3a1d-4c22-8375-d9b5f4e0f166 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] HTTP exception thrown: Instance ec9a988c-b152-4e39-ad48-c2f7facd203f could not be found. Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a298ff30-3a1d-4c22-8375-d9b5f4e0f166 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Request method failure captured: Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f HTTP/1.1 Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmShO0WCIT-ieTC0TkC22s2NgbPlbfYeqpu6ROdq8R33p7FSdk6nRhMJ93KK-8IHs5QOrFvm_sEVfOUeogXN52RInGKn0Kxp-2OpFT2Jgz_XZ06W7SW8L7lfFPi06ojVje3oQHlU_gM4OkbLVA2s3lIWcHbQTzatflVFkFwfj3nFjlg Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 40256802535d4aedb2541246a687ec76 Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-AttachVolumeTestJSON-66162385 Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:56:21.191918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:56:21.199297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/40256802535d4aedb2541246a687ec76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/40256802535d4aedb2541246a687ec76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_40256802535d4aedb2541246a687ec76", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/40256802535d4aedb2541246a687ec76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:56:21.199297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-AttachVolumeTestJSON-66162385 Aug 24 17:56:21.199297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 40256802535d4aedb2541246a687ec76 Aug 24 17:56:21.199297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-AttachVolumeTestJSON-66162385 Aug 24 17:56:21.199297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-AttachVolumeTestJSON-66162385-project Aug 24 17:56:21.199297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:56:21.199297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:56:21.199297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: 2b6b0d0cbdb54a46a7e9d6936c47cc4c Aug 24 17:56:21.199297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-AttachVolumeTestJSON-66162385-project Aug 24 17:56:21.199297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:56:21.199297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance ec9a988c-b152-4e39-ad48-c2f7facd203f could not be found. Aug 24 17:56:21.199297 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': 'ec9a988c-b152-4e39-ad48-c2f7facd203f'} Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec9a988c-b152-4e39-ad48-c2f7facd203f could not be found. Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:21.200620 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:21.202154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:21.202154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:56:21.202154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:56:21.202154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:21.202154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:21.202154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:21.202154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:21.202154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec9a988c-b152-4e39-ad48-c2f7facd203f could not be found. Aug 24 17:56:21.202154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:21.202154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:21.202154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:21.202154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:21.202154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:21.202154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:21.202154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:21.202154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:21.202154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec9a988c-b152-4e39-ad48-c2f7facd203f could not be found. Aug 24 17:56:21.202154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:21.203538 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a298ff30-3a1d-4c22-8375-d9b5f4e0f166 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] Returning 404 to user: Instance ec9a988c-b152-4e39-ad48-c2f7facd203f could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:21.203538 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a298ff30-3a1d-4c22-8375-d9b5f4e0f166 tempest-AttachVolumeTestJSON-66162385 tempest-AttachVolumeTestJSON-66162385-project] 10.222.0.76 "GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f" status: 404 len: 111 microversion: 2.1 time: 0.032202 Aug 24 17:56:21.203538 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 522/1040] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:21 2022] GET /compute/v2.1/servers/ec9a988c-b152-4e39-ad48-c2f7facd203f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:56:24.236091 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-507d9a24-5acb-4da9-88ae-211e839794f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:24.238631 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-507d9a24-5acb-4da9-88ae-211e839794f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:24.279318 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-507d9a24-5acb-4da9-88ae-211e839794f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:24.285895 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-507d9a24-5acb-4da9-88ae-211e839794f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:24.288485 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-507d9a24-5acb-4da9-88ae-211e839794f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:24.289416 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-507d9a24-5acb-4da9-88ae-211e839794f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:24.304499 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-507d9a24-5acb-4da9-88ae-211e839794f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:24.304499 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-507d9a24-5acb-4da9-88ae-211e839794f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:24.377902 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-507d9a24-5acb-4da9-88ae-211e839794f8 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.146397 Aug 24 17:56:24.378979 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 519/1041] 10.222.0.76 () {60 vars in 1343 bytes} [Wed Aug 24 17:56:24 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:24.462577 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1e596730-db51-45bf-ae7d-0b692edaf7e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:24.463747 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1e596730-db51-45bf-ae7d-0b692edaf7e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:24.471736 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1e596730-db51-45bf-ae7d-0b692edaf7e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:24.472765 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1e596730-db51-45bf-ae7d-0b692edaf7e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:24.473786 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1e596730-db51-45bf-ae7d-0b692edaf7e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:24.474836 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1e596730-db51-45bf-ae7d-0b692edaf7e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:24.475803 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1e596730-db51-45bf-ae7d-0b692edaf7e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:24.476815 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1e596730-db51-45bf-ae7d-0b692edaf7e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:24.505678 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1e596730-db51-45bf-ae7d-0b692edaf7e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Going to try to terminate instance {{(pid=127677) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:56:24.957008 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1e596730-db51-45bf-ae7d-0b692edaf7e0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "DELETE /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 204 len: 0 microversion: 2.20 time: 0.497921 Aug 24 17:56:24.958751 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 523/1042] 10.222.0.76 () {60 vars in 1280 bytes} [Wed Aug 24 17:56:24 2022] DELETE /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 17:56:24.971546 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-42f55ae9-0e3f-4553-853b-b2dc06787258 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:24.976269 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-42f55ae9-0e3f-4553-853b-b2dc06787258 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:25.021704 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-42f55ae9-0e3f-4553-853b-b2dc06787258 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:25.024908 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-42f55ae9-0e3f-4553-853b-b2dc06787258 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:25.028416 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-42f55ae9-0e3f-4553-853b-b2dc06787258 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:25.031688 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-42f55ae9-0e3f-4553-853b-b2dc06787258 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:25.036187 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-42f55ae9-0e3f-4553-853b-b2dc06787258 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:25.038783 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-42f55ae9-0e3f-4553-853b-b2dc06787258 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:25.274155 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-42f55ae9-0e3f-4553-853b-b2dc06787258 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:25.288957 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-42f55ae9-0e3f-4553-853b-b2dc06787258 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:25.296200 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-42f55ae9-0e3f-4553-853b-b2dc06787258 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:25.296200 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-42f55ae9-0e3f-4553-853b-b2dc06787258 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1723 microversion: 2.20 time: 0.329227 Aug 24 17:56:25.296200 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 520/1043] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:56:24 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:56:26.317470 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-7ccfdbd6-ea70-4d9c-97ce-a90be0c37bdb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:26.318205 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-7ccfdbd6-ea70-4d9c-97ce-a90be0c37bdb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:26.325040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7ccfdbd6-ea70-4d9c-97ce-a90be0c37bdb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:26.332103 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7ccfdbd6-ea70-4d9c-97ce-a90be0c37bdb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:26.332103 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7ccfdbd6-ea70-4d9c-97ce-a90be0c37bdb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:26.332103 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7ccfdbd6-ea70-4d9c-97ce-a90be0c37bdb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:26.332103 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7ccfdbd6-ea70-4d9c-97ce-a90be0c37bdb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:26.332539 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-7ccfdbd6-ea70-4d9c-97ce-a90be0c37bdb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:26.626560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7ccfdbd6-ea70-4d9c-97ce-a90be0c37bdb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:26.741702 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7ccfdbd6-ea70-4d9c-97ce-a90be0c37bdb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:26.743286 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-7ccfdbd6-ea70-4d9c-97ce-a90be0c37bdb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:26.744678 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-7ccfdbd6-ea70-4d9c-97ce-a90be0c37bdb tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1723 microversion: 2.20 time: 0.431396 Aug 24 17:56:26.745712 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 524/1044] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:56:26 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1723 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:56:27.490640 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-239dd068-22b0-42d3-a482-5d9e13b2a6f0 req-1425059e-076e-4e43-90c4-5f7ab27dd62a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861f638b-1bdf-459e-bf10-2846d8994ac4", "name": "network-vif-deleted", "tag": "83c659e2-8827-4402-9131-6edb2b9b0a44"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:27.502160 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-239dd068-22b0-42d3-a482-5d9e13b2a6f0 req-1425059e-076e-4e43-90c4-5f7ab27dd62a service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:27.502712 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-239dd068-22b0-42d3-a482-5d9e13b2a6f0 req-1425059e-076e-4e43-90c4-5f7ab27dd62a service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:27.503171 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-239dd068-22b0-42d3-a482-5d9e13b2a6f0 req-1425059e-076e-4e43-90c4-5f7ab27dd62a service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:27.516357 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-239dd068-22b0-42d3-a482-5d9e13b2a6f0 req-1425059e-076e-4e43-90c4-5f7ab27dd62a service nova] Creating event network-vif-deleted:83c659e2-8827-4402-9131-6edb2b9b0a44 for instance 861f638b-1bdf-459e-bf10-2846d8994ac4 on hv-cinder-85442 Aug 24 17:56:27.522338 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-239dd068-22b0-42d3-a482-5d9e13b2a6f0 req-1425059e-076e-4e43-90c4-5f7ab27dd62a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035469 Aug 24 17:56:27.523121 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 521/1045] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:27.772570 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-90d2ab7a-fd57-47a8-b477-673300cf5922 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:27.773209 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-90d2ab7a-fd57-47a8-b477-673300cf5922 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:27.813591 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90d2ab7a-fd57-47a8-b477-673300cf5922 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:27.814530 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90d2ab7a-fd57-47a8-b477-673300cf5922 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:27.815159 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90d2ab7a-fd57-47a8-b477-673300cf5922 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:27.816860 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90d2ab7a-fd57-47a8-b477-673300cf5922 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:27.819270 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90d2ab7a-fd57-47a8-b477-673300cf5922 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:27.819893 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90d2ab7a-fd57-47a8-b477-673300cf5922 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:27.954277 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90d2ab7a-fd57-47a8-b477-673300cf5922 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:27.954277 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90d2ab7a-fd57-47a8-b477-673300cf5922 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:27.954277 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-90d2ab7a-fd57-47a8-b477-673300cf5922 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:27.954277 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-90d2ab7a-fd57-47a8-b477-673300cf5922 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lazy-loading 'fault' on Instance uuid 861f638b-1bdf-459e-bf10-2846d8994ac4 {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:56:28.047183 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-90d2ab7a-fd57-47a8-b477-673300cf5922 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:28.058552 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-90d2ab7a-fd57-47a8-b477-673300cf5922 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:28.060100 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-90d2ab7a-fd57-47a8-b477-673300cf5922 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '612dfebb8ebc401bb81d3d3333577566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9398272c7a3f4a50a38df4b5dec9ac90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:28.064849 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-90d2ab7a-fd57-47a8-b477-673300cf5922 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 200 len: 1371 microversion: 2.20 time: 0.299660 Aug 24 17:56:28.065359 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 525/1046] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:56:27 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 1371 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:56:29.091112 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-98b7d2ea-e808-467c-8622-4a9ceda8a5da tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:29.091846 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-98b7d2ea-e808-467c-8622-4a9ceda8a5da tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:29.101608 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98b7d2ea-e808-467c-8622-4a9ceda8a5da tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:29.101608 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98b7d2ea-e808-467c-8622-4a9ceda8a5da tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:29.101608 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98b7d2ea-e808-467c-8622-4a9ceda8a5da tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:29.101608 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98b7d2ea-e808-467c-8622-4a9ceda8a5da tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:29.101971 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98b7d2ea-e808-467c-8622-4a9ceda8a5da tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:29.101971 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98b7d2ea-e808-467c-8622-4a9ceda8a5da tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:29.116566 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-98b7d2ea-e808-467c-8622-4a9ceda8a5da tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] HTTP exception thrown: Instance 861f638b-1bdf-459e-bf10-2846d8994ac4 could not be found. Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-98b7d2ea-e808-467c-8622-4a9ceda8a5da tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Request method failure captured: Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 HTTP/1.1 Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmSk5iMtuYydttn7hEIrtz40Lsk0SWcumQLhHV0Yf30yrwyN8KK5JOdD-oy4auRdOq0TwWoA5gJHttiNDyWAwrcNJGQDmZ3pNLkPDxiEbhtzondqzIfOPRkl8aqIzKHq5CGvo6SYHEIXirvNyjvzyVL-UOLYPSZ6sEDfBGGpRkM3PP8 Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 9398272c7a3f4a50a38df4b5dec9ac90 Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1996245533 Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:56:29.118256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:56:29.119922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9398272c7a3f4a50a38df4b5dec9ac90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9398272c7a3f4a50a38df4b5dec9ac90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9398272c7a3f4a50a38df4b5dec9ac90", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9398272c7a3f4a50a38df4b5dec9ac90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:56:29.119922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1996245533 Aug 24 17:56:29.119922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 9398272c7a3f4a50a38df4b5dec9ac90 Aug 24 17:56:29.119922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1996245533 Aug 24 17:56:29.119922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-AttachVolumeShelveTestJSON-1996245533-project Aug 24 17:56:29.119922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:56:29.119922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:56:29.119922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 612dfebb8ebc401bb81d3d3333577566 Aug 24 17:56:29.119922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1996245533-project Aug 24 17:56:29.119922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:56:29.119922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance 861f638b-1bdf-459e-bf10-2846d8994ac4 could not be found. Aug 24 17:56:29.119922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': '861f638b-1bdf-459e-bf10-2846d8994ac4'} Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 861f638b-1bdf-459e-bf10-2846d8994ac4 could not be found. Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:29.121145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:29.122816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:29.122816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:56:29.122816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:56:29.122816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:29.122816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:29.122816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:29.122816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:29.122816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 861f638b-1bdf-459e-bf10-2846d8994ac4 could not be found. Aug 24 17:56:29.122816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:29.122816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:29.122816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:29.122816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:29.122816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:29.122816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:29.122816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:29.122816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:29.122816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 861f638b-1bdf-459e-bf10-2846d8994ac4 could not be found. Aug 24 17:56:29.122816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:29.123996 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-98b7d2ea-e808-467c-8622-4a9ceda8a5da tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Returning 404 to user: Instance 861f638b-1bdf-459e-bf10-2846d8994ac4 could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:29.123996 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-98b7d2ea-e808-467c-8622-4a9ceda8a5da tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 404 len: 111 microversion: 2.20 time: 0.034433 Aug 24 17:56:29.123996 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 522/1047] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:56:29 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:56:29.130507 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-aecfc981-27de-45ca-9e7b-1d8ef315b923 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '.version_select at 0x7fce77489c10>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:29.245895 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-aecfc981-27de-45ca-9e7b-1d8ef315b923 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-488806812" status: 204 len: 0 microversion: 2.20 time: 0.119610 Aug 24 17:56:29.246482 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 526/1048] 10.222.0.76 () {60 vars in 1259 bytes} [Wed Aug 24 17:56:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-488806812 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 17:56:31.993749 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ff09462c-67f5-45b9-838e-d4074c6bf47b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:31.994298 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-ff09462c-67f5-45b9-838e-d4074c6bf47b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:32.000797 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ff09462c-67f5-45b9-838e-d4074c6bf47b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:32.001281 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ff09462c-67f5-45b9-838e-d4074c6bf47b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:32.001724 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ff09462c-67f5-45b9-838e-d4074c6bf47b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:32.003591 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ff09462c-67f5-45b9-838e-d4074c6bf47b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:32.004063 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ff09462c-67f5-45b9-838e-d4074c6bf47b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:32.004501 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ff09462c-67f5-45b9-838e-d4074c6bf47b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:32.019647 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-ff09462c-67f5-45b9-838e-d4074c6bf47b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] HTTP exception thrown: Instance 861f638b-1bdf-459e-bf10-2846d8994ac4 could not be found. Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ff09462c-67f5-45b9-838e-d4074c6bf47b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Request method failure captured: Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: DELETE /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 HTTP/1.1 Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmSk5iMtuYydttn7hEIrtz40Lsk0SWcumQLhHV0Yf30yrwyN8KK5JOdD-oy4auRdOq0TwWoA5gJHttiNDyWAwrcNJGQDmZ3pNLkPDxiEbhtzondqzIfOPRkl8aqIzKHq5CGvo6SYHEIXirvNyjvzyVL-UOLYPSZ6sEDfBGGpRkM3PP8 Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 9398272c7a3f4a50a38df4b5dec9ac90 Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1996245533 Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:56:32.021245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:56:32.022945 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9398272c7a3f4a50a38df4b5dec9ac90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9398272c7a3f4a50a38df4b5dec9ac90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9398272c7a3f4a50a38df4b5dec9ac90", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9398272c7a3f4a50a38df4b5dec9ac90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:56:32.022945 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1996245533 Aug 24 17:56:32.022945 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 9398272c7a3f4a50a38df4b5dec9ac90 Aug 24 17:56:32.022945 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1996245533 Aug 24 17:56:32.022945 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-AttachVolumeShelveTestJSON-1996245533-project Aug 24 17:56:32.022945 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:56:32.022945 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:56:32.022945 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 612dfebb8ebc401bb81d3d3333577566 Aug 24 17:56:32.022945 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1996245533-project Aug 24 17:56:32.022945 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:56:32.022945 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance 861f638b-1bdf-459e-bf10-2846d8994ac4 could not be found. Aug 24 17:56:32.022945 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': '861f638b-1bdf-459e-bf10-2846d8994ac4'} Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 861f638b-1bdf-459e-bf10-2846d8994ac4 could not be found. Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:32.023808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 861f638b-1bdf-459e-bf10-2846d8994ac4 could not be found. Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 861f638b-1bdf-459e-bf10-2846d8994ac4 could not be found. Aug 24 17:56:32.025370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:32.027573 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ff09462c-67f5-45b9-838e-d4074c6bf47b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Returning 404 to user: Instance 861f638b-1bdf-459e-bf10-2846d8994ac4 could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:32.027573 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-ff09462c-67f5-45b9-838e-d4074c6bf47b tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "DELETE /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 404 len: 111 microversion: 2.20 time: 0.032930 Aug 24 17:56:32.027573 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 523/1049] 10.222.0.76 () {60 vars in 1280 bytes} [Wed Aug 24 17:56:31 2022] DELETE /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 17:56:32.032877 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a6448e7b-5834-40b8-ac65-7f2bc172e805 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:32.036631 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a6448e7b-5834-40b8-ac65-7f2bc172e805 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 861f638b-1bdf-459e-bf10-2846d8994ac4] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:32.040899 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a6448e7b-5834-40b8-ac65-7f2bc172e805 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:32.042336 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a6448e7b-5834-40b8-ac65-7f2bc172e805 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:32.042792 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a6448e7b-5834-40b8-ac65-7f2bc172e805 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:32.043511 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a6448e7b-5834-40b8-ac65-7f2bc172e805 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:32.043981 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a6448e7b-5834-40b8-ac65-7f2bc172e805 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:32.044418 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a6448e7b-5834-40b8-ac65-7f2bc172e805 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:32.061751 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-a6448e7b-5834-40b8-ac65-7f2bc172e805 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] HTTP exception thrown: Instance 861f638b-1bdf-459e-bf10-2846d8994ac4 could not be found. Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a6448e7b-5834-40b8-ac65-7f2bc172e805 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Request method failure captured: Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 HTTP/1.1 Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmSk5iMtuYydttn7hEIrtz40Lsk0SWcumQLhHV0Yf30yrwyN8KK5JOdD-oy4auRdOq0TwWoA5gJHttiNDyWAwrcNJGQDmZ3pNLkPDxiEbhtzondqzIfOPRkl8aqIzKHq5CGvo6SYHEIXirvNyjvzyVL-UOLYPSZ6sEDfBGGpRkM3PP8 Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 9398272c7a3f4a50a38df4b5dec9ac90 Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1996245533 Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:56:32.063473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:56:32.066674 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9398272c7a3f4a50a38df4b5dec9ac90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9398272c7a3f4a50a38df4b5dec9ac90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9398272c7a3f4a50a38df4b5dec9ac90", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9398272c7a3f4a50a38df4b5dec9ac90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:56:32.066674 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1996245533 Aug 24 17:56:32.066674 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 9398272c7a3f4a50a38df4b5dec9ac90 Aug 24 17:56:32.066674 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1996245533 Aug 24 17:56:32.066674 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-AttachVolumeShelveTestJSON-1996245533-project Aug 24 17:56:32.066674 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:56:32.066674 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:56:32.066674 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: 612dfebb8ebc401bb81d3d3333577566 Aug 24 17:56:32.066674 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1996245533-project Aug 24 17:56:32.066674 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:56:32.066674 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance 861f638b-1bdf-459e-bf10-2846d8994ac4 could not be found. Aug 24 17:56:32.066674 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': '861f638b-1bdf-459e-bf10-2846d8994ac4'} Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 861f638b-1bdf-459e-bf10-2846d8994ac4 could not be found. Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:32.067560 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:32.068969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:32.068969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:56:32.068969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:56:32.068969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:32.068969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:32.068969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:32.068969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:32.068969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 861f638b-1bdf-459e-bf10-2846d8994ac4 could not be found. Aug 24 17:56:32.068969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:32.068969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:32.068969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:32.068969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:32.068969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:32.068969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:32.068969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:32.068969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:32.068969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 861f638b-1bdf-459e-bf10-2846d8994ac4 could not be found. Aug 24 17:56:32.068969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:32.070320 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a6448e7b-5834-40b8-ac65-7f2bc172e805 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Returning 404 to user: Instance 861f638b-1bdf-459e-bf10-2846d8994ac4 could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:32.070320 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a6448e7b-5834-40b8-ac65-7f2bc172e805 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4" status: 404 len: 111 microversion: 2.20 time: 0.036774 Aug 24 17:56:32.070320 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 527/1050] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:56:32 2022] GET /compute/v2.1/servers/861f638b-1bdf-459e-bf10-2846d8994ac4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 17:56:33.396002 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d9cce60d-9755-4ae7-a6b9-4850603357a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:33.396537 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d9cce60d-9755-4ae7-a6b9-4850603357a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:33.403907 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d9cce60d-9755-4ae7-a6b9-4850603357a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:33.404396 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d9cce60d-9755-4ae7-a6b9-4850603357a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:33.404891 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d9cce60d-9755-4ae7-a6b9-4850603357a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:33.405587 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d9cce60d-9755-4ae7-a6b9-4850603357a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:33.406089 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d9cce60d-9755-4ae7-a6b9-4850603357a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:33.406558 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d9cce60d-9755-4ae7-a6b9-4850603357a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:33.421145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-d9cce60d-9755-4ae7-a6b9-4850603357a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] HTTP exception thrown: Instance 154f9aac-b081-4041-ba41-dd14fb267e29 could not be found. Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d9cce60d-9755-4ae7-a6b9-4850603357a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Request method failure captured: Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: DELETE /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 HTTP/1.1 Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmSk5iMtuYydttn7hEIrtz40Lsk0SWcumQLhHV0Yf30yrwyN8KK5JOdD-oy4auRdOq0TwWoA5gJHttiNDyWAwrcNJGQDmZ3pNLkPDxiEbhtzondqzIfOPRkl8aqIzKHq5CGvo6SYHEIXirvNyjvzyVL-UOLYPSZ6sEDfBGGpRkM3PP8 Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 9398272c7a3f4a50a38df4b5dec9ac90 Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1996245533 Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:56:33.422879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:56:33.424273 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9398272c7a3f4a50a38df4b5dec9ac90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9398272c7a3f4a50a38df4b5dec9ac90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9398272c7a3f4a50a38df4b5dec9ac90", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9398272c7a3f4a50a38df4b5dec9ac90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:56:33.424273 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1996245533 Aug 24 17:56:33.424273 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 9398272c7a3f4a50a38df4b5dec9ac90 Aug 24 17:56:33.424273 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1996245533 Aug 24 17:56:33.424273 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-AttachVolumeShelveTestJSON-1996245533-project Aug 24 17:56:33.424273 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:56:33.424273 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:56:33.424273 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: 612dfebb8ebc401bb81d3d3333577566 Aug 24 17:56:33.424273 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1996245533-project Aug 24 17:56:33.424273 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:56:33.424273 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance 154f9aac-b081-4041-ba41-dd14fb267e29 could not be found. Aug 24 17:56:33.424273 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': '154f9aac-b081-4041-ba41-dd14fb267e29'} Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 154f9aac-b081-4041-ba41-dd14fb267e29 could not be found. Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:33.425163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 154f9aac-b081-4041-ba41-dd14fb267e29 could not be found. Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 154f9aac-b081-4041-ba41-dd14fb267e29 could not be found. Aug 24 17:56:33.426414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:56:33.428711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d9cce60d-9755-4ae7-a6b9-4850603357a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Returning 404 to user: Instance 154f9aac-b081-4041-ba41-dd14fb267e29 could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:33.428711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d9cce60d-9755-4ae7-a6b9-4850603357a0 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "DELETE /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 404 len: 111 microversion: 2.20 time: 0.032627 Aug 24 17:56:33.428711 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 524/1051] 10.222.0.76 () {60 vars in 1280 bytes} [Wed Aug 24 17:56:33 2022] DELETE /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:56:33.433865 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9ba93f70-b216-4f88-a1aa-7ecc09728788 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:33.434707 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9ba93f70-b216-4f88-a1aa-7ecc09728788 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] [instance: 154f9aac-b081-4041-ba41-dd14fb267e29] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:33.448845 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9ba93f70-b216-4f88-a1aa-7ecc09728788 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:33.449275 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9ba93f70-b216-4f88-a1aa-7ecc09728788 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:33.449521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9ba93f70-b216-4f88-a1aa-7ecc09728788 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:33.450538 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9ba93f70-b216-4f88-a1aa-7ecc09728788 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:33.451054 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9ba93f70-b216-4f88-a1aa-7ecc09728788 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:33.451524 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9ba93f70-b216-4f88-a1aa-7ecc09728788 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:33.468368 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-9ba93f70-b216-4f88-a1aa-7ecc09728788 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] HTTP exception thrown: Instance 154f9aac-b081-4041-ba41-dd14fb267e29 could not be found. Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9ba93f70-b216-4f88-a1aa-7ecc09728788 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Request method failure captured: Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 HTTP/1.1 Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmSk5iMtuYydttn7hEIrtz40Lsk0SWcumQLhHV0Yf30yrwyN8KK5JOdD-oy4auRdOq0TwWoA5gJHttiNDyWAwrcNJGQDmZ3pNLkPDxiEbhtzondqzIfOPRkl8aqIzKHq5CGvo6SYHEIXirvNyjvzyVL-UOLYPSZ6sEDfBGGpRkM3PP8 Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 9398272c7a3f4a50a38df4b5dec9ac90 Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1996245533 Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 17:56:33.469979 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 17:56:33.471657 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/9398272c7a3f4a50a38df4b5dec9ac90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9398272c7a3f4a50a38df4b5dec9ac90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_9398272c7a3f4a50a38df4b5dec9ac90", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/9398272c7a3f4a50a38df4b5dec9ac90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:56:33.471657 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1996245533 Aug 24 17:56:33.471657 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 9398272c7a3f4a50a38df4b5dec9ac90 Aug 24 17:56:33.471657 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1996245533 Aug 24 17:56:33.471657 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-AttachVolumeShelveTestJSON-1996245533-project Aug 24 17:56:33.471657 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 17:56:33.471657 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 17:56:33.471657 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: 612dfebb8ebc401bb81d3d3333577566 Aug 24 17:56:33.471657 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1996245533-project Aug 24 17:56:33.471657 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 17:56:33.471657 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance 154f9aac-b081-4041-ba41-dd14fb267e29 could not be found. Aug 24 17:56:33.471657 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': '154f9aac-b081-4041-ba41-dd14fb267e29'} Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 154f9aac-b081-4041-ba41-dd14fb267e29 could not be found. Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:33.472450 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:33.473809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:33.473809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:56:33.473809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:56:33.473809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:56:33.473809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:56:33.473809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:56:33.473809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:56:33.473809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 154f9aac-b081-4041-ba41-dd14fb267e29 could not be found. Aug 24 17:56:33.473809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:33.473809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:33.473809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:33.473809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:33.473809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:33.473809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:33.473809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:33.473809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:33.473809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 154f9aac-b081-4041-ba41-dd14fb267e29 could not be found. Aug 24 17:56:33.473809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 17:56:33.475035 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9ba93f70-b216-4f88-a1aa-7ecc09728788 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] Returning 404 to user: Instance 154f9aac-b081-4041-ba41-dd14fb267e29 could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:33.475035 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9ba93f70-b216-4f88-a1aa-7ecc09728788 tempest-AttachVolumeShelveTestJSON-1996245533 tempest-AttachVolumeShelveTestJSON-1996245533-project] 10.222.0.76 "GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29" status: 404 len: 111 microversion: 2.20 time: 0.042092 Aug 24 17:56:33.475035 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 528/1052] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 17:56:33 2022] GET /compute/v2.1/servers/154f9aac-b081-4041-ba41-dd14fb267e29 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:57:37.096270 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:57:37.096994 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Wed Aug 24 17:57:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:57:59.836670 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=39 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:59.840303 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=25 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:59.841418 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5ce8b1f1-0211-4daf-a981-0374641cab18 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1416891032", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1931889606", "security_groups": [{"name": "tempest-secgroup-smoke-1999771964"}], "block_device_mapping_v2": [{"uuid": "10d4d3fc-ba05-43f4-a100-99c092a0ca82", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2846555c-99d6-42dd-b3aa-b589c6b8e767"}]}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:00.116905 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.network.neutron [None req-5ce8b1f1-0211-4daf-a981-0374641cab18 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] validate_networks() for [('2846555c-99d6-42dd-b3aa-b589c6b8e767', None, None, None, None, None)] {{(pid=127676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:58:00.501366 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-5ce8b1f1-0211-4daf-a981-0374641cab18 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Flavor limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:58:00.501786 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-5ce8b1f1-0211-4daf-a981-0374641cab18 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Image limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:58:00.502289 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-5ce8b1f1-0211-4daf-a981-0374641cab18 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Flavor pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:58:00.502690 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-5ce8b1f1-0211-4daf-a981-0374641cab18 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Image pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:58:00.503096 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-5ce8b1f1-0211-4daf-a981-0374641cab18 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:58:00.512949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5ce8b1f1-0211-4daf-a981-0374641cab18 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:00.513691 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5ce8b1f1-0211-4daf-a981-0374641cab18 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:00.514155 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5ce8b1f1-0211-4daf-a981-0374641cab18 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:00.514882 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5ce8b1f1-0211-4daf-a981-0374641cab18 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:00.515415 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5ce8b1f1-0211-4daf-a981-0374641cab18 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:00.515896 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5ce8b1f1-0211-4daf-a981-0374641cab18 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:00.532577 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-5ce8b1f1-0211-4daf-a981-0374641cab18 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Getting quotas for project 54cebab3bf1f440dbaa4ef020177a4bb. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:58:00.536684 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-5ce8b1f1-0211-4daf-a981-0374641cab18 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Getting quotas for user f19bf0e6a8ad425cbbf804d6d7be5a0a and project 54cebab3bf1f440dbaa4ef020177a4bb. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:58:00.595172 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5ce8b1f1-0211-4daf-a981-0374641cab18 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Going to run 1 instances... {{(pid=127676) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:58:00.597591 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5ce8b1f1-0211-4daf-a981-0374641cab18 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='10d4d3fc-ba05-43f4-a100-99c092a0ca82',volume_size=None,volume_type=None)] {{(pid=127676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:58:01.153122 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5ce8b1f1-0211-4daf-a981-0374641cab18 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.318860 Aug 24 17:58:01.154111 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 525/1053] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 17:57:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:58:01.164005 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:01.166233 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=88,nova_cell1:INSERT=2 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:01.171521 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-d6109736-1bc5-490e-b17b-e9c1479a789a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:01.173922 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-d6109736-1bc5-490e-b17b-e9c1479a789a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:01.237985 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-d6109736-1bc5-490e-b17b-e9c1479a789a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:01.245822 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-d6109736-1bc5-490e-b17b-e9c1479a789a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1095 microversion: 2.1 time: 0.085021 Aug 24 17:58:01.246484 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 529/1054] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:01 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1095 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:58:02.267298 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-433c37d0-8fbd-40fc-bf31-ac259543c33e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:02.267911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-433c37d0-8fbd-40fc-bf31-ac259543c33e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:02.274063 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-433c37d0-8fbd-40fc-bf31-ac259543c33e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:02.274548 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-433c37d0-8fbd-40fc-bf31-ac259543c33e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:02.274988 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-433c37d0-8fbd-40fc-bf31-ac259543c33e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:02.275761 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-433c37d0-8fbd-40fc-bf31-ac259543c33e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:02.276219 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-433c37d0-8fbd-40fc-bf31-ac259543c33e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:02.276644 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-433c37d0-8fbd-40fc-bf31-ac259543c33e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:02.339773 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-433c37d0-8fbd-40fc-bf31-ac259543c33e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:02.347582 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-433c37d0-8fbd-40fc-bf31-ac259543c33e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1145 microversion: 2.1 time: 0.084950 Aug 24 17:58:02.352970 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 526/1055] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:02 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:03.370252 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9d3c7eea-85aa-4079-971a-93e2cb0d62e0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:03.370868 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9d3c7eea-85aa-4079-971a-93e2cb0d62e0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:03.378927 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9d3c7eea-85aa-4079-971a-93e2cb0d62e0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:03.379408 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9d3c7eea-85aa-4079-971a-93e2cb0d62e0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:03.381735 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9d3c7eea-85aa-4079-971a-93e2cb0d62e0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:03.381735 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9d3c7eea-85aa-4079-971a-93e2cb0d62e0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:03.381735 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9d3c7eea-85aa-4079-971a-93e2cb0d62e0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:03.381735 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9d3c7eea-85aa-4079-971a-93e2cb0d62e0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:03.451079 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9d3c7eea-85aa-4079-971a-93e2cb0d62e0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:03.459420 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9d3c7eea-85aa-4079-971a-93e2cb0d62e0 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1145 microversion: 2.1 time: 0.094321 Aug 24 17:58:03.460139 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 530/1056] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:03 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1145 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:04.481075 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b1660ca3-5789-4a1f-9664-3b2c119e8f22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:04.482847 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-b1660ca3-5789-4a1f-9664-3b2c119e8f22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:04.490155 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b1660ca3-5789-4a1f-9664-3b2c119e8f22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:04.490645 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b1660ca3-5789-4a1f-9664-3b2c119e8f22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:04.491086 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b1660ca3-5789-4a1f-9664-3b2c119e8f22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:04.491794 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b1660ca3-5789-4a1f-9664-3b2c119e8f22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:04.492579 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b1660ca3-5789-4a1f-9664-3b2c119e8f22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:04.493255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b1660ca3-5789-4a1f-9664-3b2c119e8f22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:04.569118 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b1660ca3-5789-4a1f-9664-3b2c119e8f22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:04.582245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b1660ca3-5789-4a1f-9664-3b2c119e8f22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1201 microversion: 2.1 time: 0.105218 Aug 24 17:58:04.585064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 527/1057] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:04 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1201 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:05.623558 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-6ec63e4c-0afc-40e7-b25c-ba71f5014c04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:05.624764 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-6ec63e4c-0afc-40e7-b25c-ba71f5014c04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:05.632943 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6ec63e4c-0afc-40e7-b25c-ba71f5014c04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:05.634052 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6ec63e4c-0afc-40e7-b25c-ba71f5014c04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:05.634595 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6ec63e4c-0afc-40e7-b25c-ba71f5014c04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:05.635539 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6ec63e4c-0afc-40e7-b25c-ba71f5014c04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:05.635999 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6ec63e4c-0afc-40e7-b25c-ba71f5014c04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:05.636603 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6ec63e4c-0afc-40e7-b25c-ba71f5014c04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:06.169533 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-6ec63e4c-0afc-40e7-b25c-ba71f5014c04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:06.178675 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-6ec63e4c-0afc-40e7-b25c-ba71f5014c04 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1279 microversion: 2.1 time: 0.562779 Aug 24 17:58:06.179494 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 531/1058] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:05 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1279 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:06.651178 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-062ee9e9-3557-4ed3-8d64-916319008d2d req-e7c89a9a-a986-4a5c-917b-e478ed29b390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69505209-dd3b-400e-a4d9-1bf3d7f3af32", "tag": "5d68095a-7771-47f5-8f50-318fc40b06a0"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:06.663733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-062ee9e9-3557-4ed3-8d64-916319008d2d req-e7c89a9a-a986-4a5c-917b-e478ed29b390 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:06.664242 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-062ee9e9-3557-4ed3-8d64-916319008d2d req-e7c89a9a-a986-4a5c-917b-e478ed29b390 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:06.665242 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-062ee9e9-3557-4ed3-8d64-916319008d2d req-e7c89a9a-a986-4a5c-917b-e478ed29b390 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:06.682208 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-062ee9e9-3557-4ed3-8d64-916319008d2d req-e7c89a9a-a986-4a5c-917b-e478ed29b390 service nova] Creating event network-changed:5d68095a-7771-47f5-8f50-318fc40b06a0 for instance 69505209-dd3b-400e-a4d9-1bf3d7f3af32 on hv-cinder-85442 Aug 24 17:58:06.683057 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-062ee9e9-3557-4ed3-8d64-916319008d2d req-e7c89a9a-a986-4a5c-917b-e478ed29b390 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036543 Aug 24 17:58:06.683963 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 528/1059] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:07.203671 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a628ba40-6f54-47d7-ae95-addc1ce5f6e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:07.203671 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a628ba40-6f54-47d7-ae95-addc1ce5f6e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:07.212869 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a628ba40-6f54-47d7-ae95-addc1ce5f6e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:07.213356 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a628ba40-6f54-47d7-ae95-addc1ce5f6e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:07.213807 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a628ba40-6f54-47d7-ae95-addc1ce5f6e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:07.214537 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a628ba40-6f54-47d7-ae95-addc1ce5f6e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:07.214990 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a628ba40-6f54-47d7-ae95-addc1ce5f6e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:07.216690 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a628ba40-6f54-47d7-ae95-addc1ce5f6e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:07.471555 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a628ba40-6f54-47d7-ae95-addc1ce5f6e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:07.479296 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a628ba40-6f54-47d7-ae95-addc1ce5f6e7 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1267 microversion: 2.1 time: 0.282391 Aug 24 17:58:07.480178 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 532/1060] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:07 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1267 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:08.501704 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-81091470-1261-4fc3-817d-56a2c0e99d8b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:08.502443 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-81091470-1261-4fc3-817d-56a2c0e99d8b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:08.508639 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-81091470-1261-4fc3-817d-56a2c0e99d8b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:08.509922 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-81091470-1261-4fc3-817d-56a2c0e99d8b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:08.510376 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-81091470-1261-4fc3-817d-56a2c0e99d8b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:08.511115 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-81091470-1261-4fc3-817d-56a2c0e99d8b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:08.511576 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-81091470-1261-4fc3-817d-56a2c0e99d8b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:08.512002 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-81091470-1261-4fc3-817d-56a2c0e99d8b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:08.651111 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-81091470-1261-4fc3-817d-56a2c0e99d8b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:08.658932 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-81091470-1261-4fc3-817d-56a2c0e99d8b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1267 microversion: 2.1 time: 0.161912 Aug 24 17:58:08.659491 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 529/1061] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:08 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:09.680098 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c4621b55-0d14-4eac-913a-2a51e574d817 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:09.680716 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c4621b55-0d14-4eac-913a-2a51e574d817 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:09.687257 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c4621b55-0d14-4eac-913a-2a51e574d817 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:09.687747 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c4621b55-0d14-4eac-913a-2a51e574d817 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:09.688187 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c4621b55-0d14-4eac-913a-2a51e574d817 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:09.689181 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c4621b55-0d14-4eac-913a-2a51e574d817 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:09.689642 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c4621b55-0d14-4eac-913a-2a51e574d817 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:09.690093 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c4621b55-0d14-4eac-913a-2a51e574d817 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:09.830345 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c4621b55-0d14-4eac-913a-2a51e574d817 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:09.838885 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c4621b55-0d14-4eac-913a-2a51e574d817 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1267 microversion: 2.1 time: 0.162614 Aug 24 17:58:09.839455 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 533/1062] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:09 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:10.860121 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b226c373-5268-473d-9223-93965ea2f005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:10.860829 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-b226c373-5268-473d-9223-93965ea2f005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:10.863370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=2 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:10.864125 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=6 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:10.868925 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b226c373-5268-473d-9223-93965ea2f005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:10.869517 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b226c373-5268-473d-9223-93965ea2f005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:10.870256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b226c373-5268-473d-9223-93965ea2f005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:10.870967 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b226c373-5268-473d-9223-93965ea2f005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:10.871429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b226c373-5268-473d-9223-93965ea2f005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:10.871860 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b226c373-5268-473d-9223-93965ea2f005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:11.016996 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b226c373-5268-473d-9223-93965ea2f005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:11.024768 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b226c373-5268-473d-9223-93965ea2f005 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1267 microversion: 2.1 time: 0.168591 Aug 24 17:58:11.029787 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 530/1063] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:10 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:12.047347 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-063882c0-0af6-498d-bc58-8cde7f456f94 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:12.049268 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-063882c0-0af6-498d-bc58-8cde7f456f94 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:12.050413 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=2 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:12.058853 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-063882c0-0af6-498d-bc58-8cde7f456f94 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:12.059342 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-063882c0-0af6-498d-bc58-8cde7f456f94 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:12.059784 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-063882c0-0af6-498d-bc58-8cde7f456f94 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:12.060489 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-063882c0-0af6-498d-bc58-8cde7f456f94 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:12.060947 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-063882c0-0af6-498d-bc58-8cde7f456f94 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:12.061379 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-063882c0-0af6-498d-bc58-8cde7f456f94 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:12.195510 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-063882c0-0af6-498d-bc58-8cde7f456f94 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:12.204437 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-063882c0-0af6-498d-bc58-8cde7f456f94 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1267 microversion: 2.1 time: 0.160946 Aug 24 17:58:12.205063 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 534/1064] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:12 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:13.226016 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7d7fa708-9ad9-429a-9bd4-d66746c54509 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:13.227459 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7d7fa708-9ad9-429a-9bd4-d66746c54509 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:13.235041 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7d7fa708-9ad9-429a-9bd4-d66746c54509 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:13.235537 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7d7fa708-9ad9-429a-9bd4-d66746c54509 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:13.235980 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7d7fa708-9ad9-429a-9bd4-d66746c54509 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:13.236697 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7d7fa708-9ad9-429a-9bd4-d66746c54509 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:13.237159 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7d7fa708-9ad9-429a-9bd4-d66746c54509 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:13.237587 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7d7fa708-9ad9-429a-9bd4-d66746c54509 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:13.377294 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7d7fa708-9ad9-429a-9bd4-d66746c54509 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:13.385660 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7d7fa708-9ad9-429a-9bd4-d66746c54509 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1267 microversion: 2.1 time: 0.163962 Aug 24 17:58:13.386249 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 531/1065] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:13 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:14.406415 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-b585b5f6-7b1e-44d6-8629-524806ca014e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:14.407160 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-b585b5f6-7b1e-44d6-8629-524806ca014e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:14.414101 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b585b5f6-7b1e-44d6-8629-524806ca014e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:14.418622 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b585b5f6-7b1e-44d6-8629-524806ca014e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:14.418622 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b585b5f6-7b1e-44d6-8629-524806ca014e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:14.418622 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b585b5f6-7b1e-44d6-8629-524806ca014e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:14.418622 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b585b5f6-7b1e-44d6-8629-524806ca014e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:14.419054 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b585b5f6-7b1e-44d6-8629-524806ca014e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:14.553290 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-b585b5f6-7b1e-44d6-8629-524806ca014e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:14.561873 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-b585b5f6-7b1e-44d6-8629-524806ca014e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1267 microversion: 2.1 time: 0.159415 Aug 24 17:58:14.562781 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 535/1066] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:14 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:15.584252 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f92bd978-ae35-4434-bf8a-9c4bbad54eaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:15.584843 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f92bd978-ae35-4434-bf8a-9c4bbad54eaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:15.592128 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f92bd978-ae35-4434-bf8a-9c4bbad54eaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:15.608828 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f92bd978-ae35-4434-bf8a-9c4bbad54eaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:15.608828 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f92bd978-ae35-4434-bf8a-9c4bbad54eaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:15.608828 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f92bd978-ae35-4434-bf8a-9c4bbad54eaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:15.608828 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f92bd978-ae35-4434-bf8a-9c4bbad54eaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:15.609238 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f92bd978-ae35-4434-bf8a-9c4bbad54eaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:15.730900 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-f92bd978-ae35-4434-bf8a-9c4bbad54eaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:15.738955 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f92bd978-ae35-4434-bf8a-9c4bbad54eaa tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1267 microversion: 2.1 time: 0.158567 Aug 24 17:58:15.739510 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 532/1067] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:15 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:16.761955 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-12a76f60-b8b7-4173-ac91-326bd028a53f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:16.762576 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-12a76f60-b8b7-4173-ac91-326bd028a53f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:16.769373 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-12a76f60-b8b7-4173-ac91-326bd028a53f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:16.770025 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-12a76f60-b8b7-4173-ac91-326bd028a53f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:16.770335 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-12a76f60-b8b7-4173-ac91-326bd028a53f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:16.771070 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-12a76f60-b8b7-4173-ac91-326bd028a53f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:16.771532 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-12a76f60-b8b7-4173-ac91-326bd028a53f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:16.771991 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-12a76f60-b8b7-4173-ac91-326bd028a53f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:17.007339 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-12a76f60-b8b7-4173-ac91-326bd028a53f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:17.020909 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-12a76f60-b8b7-4173-ac91-326bd028a53f tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1267 microversion: 2.1 time: 0.260316 Aug 24 17:58:17.020909 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 536/1068] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:16 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1267 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:18.038427 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7125e741-6a94-444f-bc8f-fcfb835771c8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:18.039086 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7125e741-6a94-444f-bc8f-fcfb835771c8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:18.045795 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7125e741-6a94-444f-bc8f-fcfb835771c8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:18.052337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7125e741-6a94-444f-bc8f-fcfb835771c8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:18.052337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7125e741-6a94-444f-bc8f-fcfb835771c8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:18.052337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7125e741-6a94-444f-bc8f-fcfb835771c8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:18.052337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7125e741-6a94-444f-bc8f-fcfb835771c8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:18.052725 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7125e741-6a94-444f-bc8f-fcfb835771c8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:18.196745 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7125e741-6a94-444f-bc8f-fcfb835771c8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:18.204846 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7125e741-6a94-444f-bc8f-fcfb835771c8 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1267 microversion: 2.1 time: 0.170399 Aug 24 17:58:18.205402 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 533/1069] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:18 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:18.522833 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-9005abde-edf2-4359-adf3-5525e21a8b78 req-01eb4cde-eef1-46df-ac4d-bbe438ed5420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69505209-dd3b-400e-a4d9-1bf3d7f3af32", "name": "network-vif-plugged", "status": "completed", "tag": "5d68095a-7771-47f5-8f50-318fc40b06a0"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:18.523288 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-9005abde-edf2-4359-adf3-5525e21a8b78 req-01eb4cde-eef1-46df-ac4d-bbe438ed5420 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:18.524335 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-9005abde-edf2-4359-adf3-5525e21a8b78 req-01eb4cde-eef1-46df-ac4d-bbe438ed5420 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:18.524769 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-9005abde-edf2-4359-adf3-5525e21a8b78 req-01eb4cde-eef1-46df-ac4d-bbe438ed5420 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:18.539514 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-9005abde-edf2-4359-adf3-5525e21a8b78 req-01eb4cde-eef1-46df-ac4d-bbe438ed5420 service nova] Creating event network-vif-plugged:5d68095a-7771-47f5-8f50-318fc40b06a0 for instance 69505209-dd3b-400e-a4d9-1bf3d7f3af32 on hv-cinder-85442 Aug 24 17:58:18.545140 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-9005abde-edf2-4359-adf3-5525e21a8b78 req-01eb4cde-eef1-46df-ac4d-bbe438ed5420 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036800 Aug 24 17:58:18.546123 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 537/1070] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:19.227700 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d0c987a6-7b7a-4555-b61b-74ddfcc29826 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:19.228476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d0c987a6-7b7a-4555-b61b-74ddfcc29826 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:19.236508 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d0c987a6-7b7a-4555-b61b-74ddfcc29826 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:19.237300 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d0c987a6-7b7a-4555-b61b-74ddfcc29826 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:19.238421 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d0c987a6-7b7a-4555-b61b-74ddfcc29826 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:19.239081 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d0c987a6-7b7a-4555-b61b-74ddfcc29826 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:19.240010 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d0c987a6-7b7a-4555-b61b-74ddfcc29826 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:19.240682 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d0c987a6-7b7a-4555-b61b-74ddfcc29826 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:19.447083 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d0c987a6-7b7a-4555-b61b-74ddfcc29826 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:19.456356 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d0c987a6-7b7a-4555-b61b-74ddfcc29826 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1267 microversion: 2.1 time: 0.233527 Aug 24 17:58:19.462788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 534/1071] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:19 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1267 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:20.477958 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1588856f-3278-4a3b-85df-f4d5f35ef6ff tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:20.479474 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1588856f-3278-4a3b-85df-f4d5f35ef6ff tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:20.487953 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1588856f-3278-4a3b-85df-f4d5f35ef6ff tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:20.487953 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1588856f-3278-4a3b-85df-f4d5f35ef6ff tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:20.488213 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1588856f-3278-4a3b-85df-f4d5f35ef6ff tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:20.488785 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1588856f-3278-4a3b-85df-f4d5f35ef6ff tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:20.489284 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1588856f-3278-4a3b-85df-f4d5f35ef6ff tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:20.489653 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1588856f-3278-4a3b-85df-f4d5f35ef6ff tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:20.725078 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1588856f-3278-4a3b-85df-f4d5f35ef6ff tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:20.734600 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1588856f-3278-4a3b-85df-f4d5f35ef6ff tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1455 microversion: 2.1 time: 0.261239 Aug 24 17:58:20.750326 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 538/1072] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:20 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1455 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:20.760681 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-589fcef8-a81e-4358-a7aa-c8a28c966d22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:20.761296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-589fcef8-a81e-4358-a7aa-c8a28c966d22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:20.778155 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-589fcef8-a81e-4358-a7aa-c8a28c966d22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:20.779141 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-589fcef8-a81e-4358-a7aa-c8a28c966d22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:20.779748 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-589fcef8-a81e-4358-a7aa-c8a28c966d22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:20.780635 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-589fcef8-a81e-4358-a7aa-c8a28c966d22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:20.783277 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-589fcef8-a81e-4358-a7aa-c8a28c966d22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:20.783945 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-589fcef8-a81e-4358-a7aa-c8a28c966d22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:20.959291 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-589fcef8-a81e-4358-a7aa-c8a28c966d22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:20.967344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-589fcef8-a81e-4358-a7aa-c8a28c966d22 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1455 microversion: 2.1 time: 0.212842 Aug 24 17:58:20.967968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 535/1073] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:20 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1455 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:23.420218 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-164d1214-98b2-4697-9ea9-38fd77962e8e req-dce25c3d-24e9-4f2f-95e7-20e8979e5282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69505209-dd3b-400e-a4d9-1bf3d7f3af32", "tag": "5d68095a-7771-47f5-8f50-318fc40b06a0"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:23.438476 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-164d1214-98b2-4697-9ea9-38fd77962e8e req-dce25c3d-24e9-4f2f-95e7-20e8979e5282 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:23.438476 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-164d1214-98b2-4697-9ea9-38fd77962e8e req-dce25c3d-24e9-4f2f-95e7-20e8979e5282 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:23.438476 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-164d1214-98b2-4697-9ea9-38fd77962e8e req-dce25c3d-24e9-4f2f-95e7-20e8979e5282 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:23.453459 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-164d1214-98b2-4697-9ea9-38fd77962e8e req-dce25c3d-24e9-4f2f-95e7-20e8979e5282 service nova] Creating event network-changed:5d68095a-7771-47f5-8f50-318fc40b06a0 for instance 69505209-dd3b-400e-a4d9-1bf3d7f3af32 on hv-cinder-85442 Aug 24 17:58:23.472415 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-164d1214-98b2-4697-9ea9-38fd77962e8e req-dce25c3d-24e9-4f2f-95e7-20e8979e5282 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057576 Aug 24 17:58:23.473292 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 539/1074] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:42.781172 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-3aa31818-3705-40b3-88b7-d4ecb1313394 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Action: 'create', calling method: .version_select at 0x7fce77404670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1325532022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINmk7omx8qwUbP4snMIEeVTHGUAgfP9RhtP8oCjmTPeBol54VWul7TlE8detfZrYyFiVQvZB1JKzueDmqGJvJTa5+1mkvwrb4JhGo13mrjwDwx7BZtbMJvx9QcpdWOMRg=="}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:42.786937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:42.787703 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=58 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:42.798999 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-3aa31818-3705-40b3-88b7-d4ecb1313394 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Getting quotas for project 193c5ec786e74f138b2fc58ab35367ff. Resources: {'key_pairs'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:58:42.802845 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-3aa31818-3705-40b3-88b7-d4ecb1313394 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Getting quotas for user 196ffd853b234fce845f359484d4b5e2 and project 193c5ec786e74f138b2fc58ab35367ff. Resources: {'key_pairs'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:58:42.887817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-3aa31818-3705-40b3-88b7-d4ecb1313394 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.110511 Aug 24 17:58:42.888411 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 536/1075] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 17:58:42 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:42.940387 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3d4c563a-5365-47e4-b631-a745707c5fad tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-614139237", "imageRef": "3fa957c9-1683-4262-b72f-950f9e2693eb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1325532022", "networks": [{"uuid": "0be31ee9-3da5-4e6c-9f30-ab26f5171772"}]}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:42.949302 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=24 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:42.949982 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=52 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:42.994354 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.network.neutron [None req-3d4c563a-5365-47e4-b631-a745707c5fad tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] validate_networks() for [('0be31ee9-3da5-4e6c-9f30-ab26f5171772', None, None, None, None, None)] {{(pid=127677) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:58:43.371860 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-3d4c563a-5365-47e4-b631-a745707c5fad tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Flavor limits 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:58:43.372314 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-3d4c563a-5365-47e4-b631-a745707c5fad tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Image limits 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:58:43.372809 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-3d4c563a-5365-47e4-b631-a745707c5fad tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Flavor pref 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:58:43.373221 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-3d4c563a-5365-47e4-b631-a745707c5fad tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Image pref 0:0:0 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:58:43.373632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.virt.hardware [None req-3d4c563a-5365-47e4-b631-a745707c5fad tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:58:43.382495 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3d4c563a-5365-47e4-b631-a745707c5fad tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:43.383014 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3d4c563a-5365-47e4-b631-a745707c5fad tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:43.383442 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3d4c563a-5365-47e4-b631-a745707c5fad tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:43.384849 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3d4c563a-5365-47e4-b631-a745707c5fad tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:43.385305 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3d4c563a-5365-47e4-b631-a745707c5fad tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:43.385732 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3d4c563a-5365-47e4-b631-a745707c5fad tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:43.402680 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-3d4c563a-5365-47e4-b631-a745707c5fad tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Getting quotas for project 193c5ec786e74f138b2fc58ab35367ff. Resources: {'instances', 'ram', 'cores'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:58:43.406668 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-3d4c563a-5365-47e4-b631-a745707c5fad tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Getting quotas for user 196ffd853b234fce845f359484d4b5e2 and project 193c5ec786e74f138b2fc58ab35367ff. Resources: {'instances', 'ram', 'cores'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:58:43.418214 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3d4c563a-5365-47e4-b631-a745707c5fad tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Going to run 1 instances... {{(pid=127677) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:58:43.420614 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3d4c563a-5365-47e4-b631-a745707c5fad tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3fa957c9-1683-4262-b72f-950f9e2693eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:58:43.645574 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3d4c563a-5365-47e4-b631-a745707c5fad tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709554 Aug 24 17:58:43.646173 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 540/1076] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 17:58:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:58:43.657350 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-4030e3bb-6b71-4772-a565-a2a357e06ac0 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:43.657991 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4030e3bb-6b71-4772-a565-a2a357e06ac0 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:43.719370 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-4030e3bb-6b71-4772-a565-a2a357e06ac0 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:43.728219 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-4030e3bb-6b71-4772-a565-a2a357e06ac0 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1258 microversion: 2.1 time: 0.074389 Aug 24 17:58:43.728976 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 537/1077] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:43 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:44.749830 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-6d80149c-cfad-440b-95f1-dd347cc219af tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:44.750494 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-6d80149c-cfad-440b-95f1-dd347cc219af tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:44.757387 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6d80149c-cfad-440b-95f1-dd347cc219af tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:44.760299 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6d80149c-cfad-440b-95f1-dd347cc219af tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:44.760299 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6d80149c-cfad-440b-95f1-dd347cc219af tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:44.760299 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6d80149c-cfad-440b-95f1-dd347cc219af tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:44.760594 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6d80149c-cfad-440b-95f1-dd347cc219af tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:44.760841 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6d80149c-cfad-440b-95f1-dd347cc219af tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:44.823112 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-6d80149c-cfad-440b-95f1-dd347cc219af tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:44.830804 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-6d80149c-cfad-440b-95f1-dd347cc219af tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1262 microversion: 2.1 time: 0.085479 Aug 24 17:58:44.831366 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 541/1078] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:44 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:45.850730 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-aae1067c-03a9-4f09-9e0a-93bc02fcbec7 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:45.851397 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-aae1067c-03a9-4f09-9e0a-93bc02fcbec7 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:45.858356 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-aae1067c-03a9-4f09-9e0a-93bc02fcbec7 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:45.858839 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-aae1067c-03a9-4f09-9e0a-93bc02fcbec7 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:45.859274 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-aae1067c-03a9-4f09-9e0a-93bc02fcbec7 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:45.859963 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-aae1067c-03a9-4f09-9e0a-93bc02fcbec7 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:45.860418 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-aae1067c-03a9-4f09-9e0a-93bc02fcbec7 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:45.860837 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-aae1067c-03a9-4f09-9e0a-93bc02fcbec7 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:45.958867 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-aae1067c-03a9-4f09-9e0a-93bc02fcbec7 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:45.967779 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-aae1067c-03a9-4f09-9e0a-93bc02fcbec7 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1318 microversion: 2.1 time: 0.120612 Aug 24 17:58:45.968373 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 538/1079] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:45 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1318 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:46.996220 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-6846856a-265d-4bb4-bfbd-b600ca644d9a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:46.997458 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-6846856a-265d-4bb4-bfbd-b600ca644d9a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:47.005000 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6846856a-265d-4bb4-bfbd-b600ca644d9a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:47.005806 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6846856a-265d-4bb4-bfbd-b600ca644d9a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:47.007185 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6846856a-265d-4bb4-bfbd-b600ca644d9a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:47.007478 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6846856a-265d-4bb4-bfbd-b600ca644d9a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:47.008159 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6846856a-265d-4bb4-bfbd-b600ca644d9a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:47.009625 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6846856a-265d-4bb4-bfbd-b600ca644d9a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:47.241900 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-6846856a-265d-4bb4-bfbd-b600ca644d9a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:47.252355 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-6846856a-265d-4bb4-bfbd-b600ca644d9a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1358 microversion: 2.1 time: 0.264801 Aug 24 17:58:47.253224 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 542/1080] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:46 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:48.277330 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d40e1a9b-e47b-4231-9395-b1936e103353 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:48.278740 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d40e1a9b-e47b-4231-9395-b1936e103353 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:48.285007 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d40e1a9b-e47b-4231-9395-b1936e103353 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:48.285494 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d40e1a9b-e47b-4231-9395-b1936e103353 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:48.285956 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d40e1a9b-e47b-4231-9395-b1936e103353 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:48.286661 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d40e1a9b-e47b-4231-9395-b1936e103353 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:48.287118 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d40e1a9b-e47b-4231-9395-b1936e103353 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:48.287545 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d40e1a9b-e47b-4231-9395-b1936e103353 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:48.431132 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d40e1a9b-e47b-4231-9395-b1936e103353 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:48.439185 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d40e1a9b-e47b-4231-9395-b1936e103353 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1358 microversion: 2.1 time: 0.168463 Aug 24 17:58:48.439755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 539/1081] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:48 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:49.460558 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c132995c-e562-47b6-bce2-3d5df13f7d71 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:49.461143 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c132995c-e562-47b6-bce2-3d5df13f7d71 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:49.468821 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c132995c-e562-47b6-bce2-3d5df13f7d71 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:49.469383 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c132995c-e562-47b6-bce2-3d5df13f7d71 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:49.469935 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c132995c-e562-47b6-bce2-3d5df13f7d71 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:49.470694 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c132995c-e562-47b6-bce2-3d5df13f7d71 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:49.471358 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c132995c-e562-47b6-bce2-3d5df13f7d71 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:49.471844 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c132995c-e562-47b6-bce2-3d5df13f7d71 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:49.615715 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c132995c-e562-47b6-bce2-3d5df13f7d71 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:49.624052 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c132995c-e562-47b6-bce2-3d5df13f7d71 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1358 microversion: 2.1 time: 0.167248 Aug 24 17:58:49.624697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 543/1082] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:49 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:50.645834 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0d9cacfd-666c-4813-9b94-a4cba80cad6f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:50.646480 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0d9cacfd-666c-4813-9b94-a4cba80cad6f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:50.652881 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0d9cacfd-666c-4813-9b94-a4cba80cad6f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:50.653321 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0d9cacfd-666c-4813-9b94-a4cba80cad6f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:50.653755 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0d9cacfd-666c-4813-9b94-a4cba80cad6f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:50.654503 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0d9cacfd-666c-4813-9b94-a4cba80cad6f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:50.654954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0d9cacfd-666c-4813-9b94-a4cba80cad6f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:50.655378 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0d9cacfd-666c-4813-9b94-a4cba80cad6f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:50.800557 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0d9cacfd-666c-4813-9b94-a4cba80cad6f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:50.810452 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0d9cacfd-666c-4813-9b94-a4cba80cad6f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1358 microversion: 2.1 time: 0.168400 Aug 24 17:58:50.811040 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 540/1083] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:50 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:51.831436 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-b675f69b-fb09-4740-b6af-e38593dfab23 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:51.832145 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-b675f69b-fb09-4740-b6af-e38593dfab23 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:51.839257 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b675f69b-fb09-4740-b6af-e38593dfab23 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:51.839751 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b675f69b-fb09-4740-b6af-e38593dfab23 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:51.840388 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b675f69b-fb09-4740-b6af-e38593dfab23 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:51.841272 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b675f69b-fb09-4740-b6af-e38593dfab23 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:51.841736 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b675f69b-fb09-4740-b6af-e38593dfab23 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:51.842409 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b675f69b-fb09-4740-b6af-e38593dfab23 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:51.983751 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-b675f69b-fb09-4740-b6af-e38593dfab23 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:51.992138 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-b675f69b-fb09-4740-b6af-e38593dfab23 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1358 microversion: 2.1 time: 0.164326 Aug 24 17:58:51.998715 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 544/1084] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:51 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:53.014042 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-daa9d419-d13a-498f-bd13-7e0a3d61da92 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:53.014672 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-daa9d419-d13a-498f-bd13-7e0a3d61da92 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:53.021837 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-daa9d419-d13a-498f-bd13-7e0a3d61da92 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:53.022364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-daa9d419-d13a-498f-bd13-7e0a3d61da92 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:53.022801 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-daa9d419-d13a-498f-bd13-7e0a3d61da92 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:53.023528 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-daa9d419-d13a-498f-bd13-7e0a3d61da92 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:53.023980 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-daa9d419-d13a-498f-bd13-7e0a3d61da92 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:53.024410 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-daa9d419-d13a-498f-bd13-7e0a3d61da92 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:53.542937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-daa9d419-d13a-498f-bd13-7e0a3d61da92 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:53.542937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-daa9d419-d13a-498f-bd13-7e0a3d61da92 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1358 microversion: 2.1 time: 0.184620 Aug 24 17:58:53.542937 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 541/1085] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:53 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:54.226030 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9b4b5761-cb31-4d6f-addd-09f7002eb476 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:54.226648 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9b4b5761-cb31-4d6f-addd-09f7002eb476 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:54.228941 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=2 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:54.229631 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=6 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:54.234500 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9b4b5761-cb31-4d6f-addd-09f7002eb476 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:54.234982 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9b4b5761-cb31-4d6f-addd-09f7002eb476 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:54.235430 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9b4b5761-cb31-4d6f-addd-09f7002eb476 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:54.236161 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9b4b5761-cb31-4d6f-addd-09f7002eb476 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:54.236622 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9b4b5761-cb31-4d6f-addd-09f7002eb476 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:54.237047 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9b4b5761-cb31-4d6f-addd-09f7002eb476 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:54.366295 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9b4b5761-cb31-4d6f-addd-09f7002eb476 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:54.374070 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9b4b5761-cb31-4d6f-addd-09f7002eb476 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1358 microversion: 2.1 time: 0.152047 Aug 24 17:58:54.375854 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 545/1086] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:54 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:55.396190 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-9ec0874e-8843-4dca-a0a9-d725fbb84d6d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:55.396875 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-9ec0874e-8843-4dca-a0a9-d725fbb84d6d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:55.400199 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=6 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:55.405496 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9ec0874e-8843-4dca-a0a9-d725fbb84d6d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:55.406021 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9ec0874e-8843-4dca-a0a9-d725fbb84d6d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:55.406463 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9ec0874e-8843-4dca-a0a9-d725fbb84d6d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:55.407272 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9ec0874e-8843-4dca-a0a9-d725fbb84d6d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:55.407726 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9ec0874e-8843-4dca-a0a9-d725fbb84d6d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:55.408157 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-9ec0874e-8843-4dca-a0a9-d725fbb84d6d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:55.636395 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-9ec0874e-8843-4dca-a0a9-d725fbb84d6d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:55.644464 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-9ec0874e-8843-4dca-a0a9-d725fbb84d6d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1358 microversion: 2.1 time: 0.252685 Aug 24 17:58:55.645035 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 542/1087] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:55 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:56.184023 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-be7bef64-3329-45f5-81ac-4307165b3ddd req-8cc80885-4ad9-4bd3-b8b8-283e521a01bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f", "tag": "aa39e6f6-d4ec-40b7-ab96-a41e7d6771ff"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:56.202735 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-be7bef64-3329-45f5-81ac-4307165b3ddd req-8cc80885-4ad9-4bd3-b8b8-283e521a01bc service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:56.204517 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-be7bef64-3329-45f5-81ac-4307165b3ddd req-8cc80885-4ad9-4bd3-b8b8-283e521a01bc service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:56.204517 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-be7bef64-3329-45f5-81ac-4307165b3ddd req-8cc80885-4ad9-4bd3-b8b8-283e521a01bc service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:56.225588 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-be7bef64-3329-45f5-81ac-4307165b3ddd req-8cc80885-4ad9-4bd3-b8b8-283e521a01bc service nova] Creating event network-changed:aa39e6f6-d4ec-40b7-ab96-a41e7d6771ff for instance 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f on hv-cinder-85442 Aug 24 17:58:56.233389 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-be7bef64-3329-45f5-81ac-4307165b3ddd req-8cc80885-4ad9-4bd3-b8b8-283e521a01bc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056783 Aug 24 17:58:56.234237 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 546/1088] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:56.665372 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-98afd774-94ed-45e3-b041-e03bf2fea1ed tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:56.666189 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-98afd774-94ed-45e3-b041-e03bf2fea1ed tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:56.672408 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98afd774-94ed-45e3-b041-e03bf2fea1ed tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:56.672901 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98afd774-94ed-45e3-b041-e03bf2fea1ed tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:56.673336 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98afd774-94ed-45e3-b041-e03bf2fea1ed tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:56.674155 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98afd774-94ed-45e3-b041-e03bf2fea1ed tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:56.674563 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98afd774-94ed-45e3-b041-e03bf2fea1ed tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:56.674997 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-98afd774-94ed-45e3-b041-e03bf2fea1ed tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:56.884345 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-98afd774-94ed-45e3-b041-e03bf2fea1ed tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:56.892412 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-98afd774-94ed-45e3-b041-e03bf2fea1ed tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1358 microversion: 2.1 time: 0.231021 Aug 24 17:58:56.892984 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 543/1089] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:56 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:57.913612 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ea1e8c7a-7393-4e68-89bd-55ed69a751e4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:57.914492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ea1e8c7a-7393-4e68-89bd-55ed69a751e4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:57.920685 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ea1e8c7a-7393-4e68-89bd-55ed69a751e4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:57.921166 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ea1e8c7a-7393-4e68-89bd-55ed69a751e4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:57.921604 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ea1e8c7a-7393-4e68-89bd-55ed69a751e4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:57.922318 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ea1e8c7a-7393-4e68-89bd-55ed69a751e4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:57.922772 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ea1e8c7a-7393-4e68-89bd-55ed69a751e4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:57.923197 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ea1e8c7a-7393-4e68-89bd-55ed69a751e4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:58.057847 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-ea1e8c7a-7393-4e68-89bd-55ed69a751e4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:58.065611 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ea1e8c7a-7393-4e68-89bd-55ed69a751e4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1358 microversion: 2.1 time: 0.156722 Aug 24 17:58:58.066214 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 547/1090] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:57 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:59.087950 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-4c8b7d70-a103-4d91-b0f5-7ae5a34b63a3 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:59.088605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4c8b7d70-a103-4d91-b0f5-7ae5a34b63a3 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:59.095139 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4c8b7d70-a103-4d91-b0f5-7ae5a34b63a3 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:59.095620 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4c8b7d70-a103-4d91-b0f5-7ae5a34b63a3 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:59.096064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4c8b7d70-a103-4d91-b0f5-7ae5a34b63a3 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:59.096763 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4c8b7d70-a103-4d91-b0f5-7ae5a34b63a3 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:59.097229 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4c8b7d70-a103-4d91-b0f5-7ae5a34b63a3 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:59.097736 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4c8b7d70-a103-4d91-b0f5-7ae5a34b63a3 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:59.235133 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-4c8b7d70-a103-4d91-b0f5-7ae5a34b63a3 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:59.242744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-4c8b7d70-a103-4d91-b0f5-7ae5a34b63a3 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1358 microversion: 2.1 time: 0.159291 Aug 24 17:58:59.243301 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 544/1091] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:59 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:00.264528 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-85fddc85-a4d9-4c56-9a7f-67c4c9619a5b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:00.265144 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-85fddc85-a4d9-4c56-9a7f-67c4c9619a5b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:00.271614 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-85fddc85-a4d9-4c56-9a7f-67c4c9619a5b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:00.272113 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-85fddc85-a4d9-4c56-9a7f-67c4c9619a5b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:00.272537 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-85fddc85-a4d9-4c56-9a7f-67c4c9619a5b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:00.273226 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-85fddc85-a4d9-4c56-9a7f-67c4c9619a5b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:00.274608 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-85fddc85-a4d9-4c56-9a7f-67c4c9619a5b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:00.275053 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-85fddc85-a4d9-4c56-9a7f-67c4c9619a5b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:00.403913 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-85fddc85-a4d9-4c56-9a7f-67c4c9619a5b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:00.411499 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-85fddc85-a4d9-4c56-9a7f-67c4c9619a5b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1358 microversion: 2.1 time: 0.151148 Aug 24 17:59:00.412049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 548/1092] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:00 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:01.431698 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a18b2271-1ba0-4675-a555-1ffe881d8418 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:01.432454 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a18b2271-1ba0-4675-a555-1ffe881d8418 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:01.438873 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a18b2271-1ba0-4675-a555-1ffe881d8418 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:01.439378 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a18b2271-1ba0-4675-a555-1ffe881d8418 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:01.439788 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a18b2271-1ba0-4675-a555-1ffe881d8418 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:01.440474 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a18b2271-1ba0-4675-a555-1ffe881d8418 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:01.440926 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a18b2271-1ba0-4675-a555-1ffe881d8418 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:01.441350 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a18b2271-1ba0-4675-a555-1ffe881d8418 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:01.574656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a18b2271-1ba0-4675-a555-1ffe881d8418 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:01.582305 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a18b2271-1ba0-4675-a555-1ffe881d8418 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1358 microversion: 2.1 time: 0.154625 Aug 24 17:59:01.582866 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 545/1093] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:01 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:02.604731 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-6de202d7-2467-4be6-9a59-17280af6e17d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:02.605412 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-6de202d7-2467-4be6-9a59-17280af6e17d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:02.612147 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6de202d7-2467-4be6-9a59-17280af6e17d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:02.612633 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6de202d7-2467-4be6-9a59-17280af6e17d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:02.613072 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6de202d7-2467-4be6-9a59-17280af6e17d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:02.613779 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6de202d7-2467-4be6-9a59-17280af6e17d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:02.614322 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6de202d7-2467-4be6-9a59-17280af6e17d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:02.614746 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-6de202d7-2467-4be6-9a59-17280af6e17d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:02.660360 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-341ef768-42d9-44f2-a19e-ec9016c862b9 req-4fae87e1-ee87-446f-ba2c-b6633e304cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f", "name": "network-vif-plugged", "status": "completed", "tag": "aa39e6f6-d4ec-40b7-ab96-a41e7d6771ff"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:59:02.672000 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-341ef768-42d9-44f2-a19e-ec9016c862b9 req-4fae87e1-ee87-446f-ba2c-b6633e304cd9 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:02.672488 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-341ef768-42d9-44f2-a19e-ec9016c862b9 req-4fae87e1-ee87-446f-ba2c-b6633e304cd9 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:02.672918 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-341ef768-42d9-44f2-a19e-ec9016c862b9 req-4fae87e1-ee87-446f-ba2c-b6633e304cd9 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:02.684574 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-341ef768-42d9-44f2-a19e-ec9016c862b9 req-4fae87e1-ee87-446f-ba2c-b6633e304cd9 service nova] Creating event network-vif-plugged:aa39e6f6-d4ec-40b7-ab96-a41e7d6771ff for instance 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f on hv-cinder-85442 Aug 24 17:59:02.689690 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-341ef768-42d9-44f2-a19e-ec9016c862b9 req-4fae87e1-ee87-446f-ba2c-b6633e304cd9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033154 Aug 24 17:59:02.694270 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 546/1094] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:59:02.747942 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-6de202d7-2467-4be6-9a59-17280af6e17d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:02.756534 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-6de202d7-2467-4be6-9a59-17280af6e17d tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1358 microversion: 2.1 time: 0.156599 Aug 24 17:59:02.757335 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 549/1095] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:02 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:59:03.781535 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-c6d8fc5c-8243-43e3-8275-dd3c3abeabf0 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:03.782260 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-c6d8fc5c-8243-43e3-8275-dd3c3abeabf0 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:03.788600 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c6d8fc5c-8243-43e3-8275-dd3c3abeabf0 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:03.789085 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c6d8fc5c-8243-43e3-8275-dd3c3abeabf0 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:03.789520 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c6d8fc5c-8243-43e3-8275-dd3c3abeabf0 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:03.790250 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c6d8fc5c-8243-43e3-8275-dd3c3abeabf0 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:03.790735 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c6d8fc5c-8243-43e3-8275-dd3c3abeabf0 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:03.791183 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c6d8fc5c-8243-43e3-8275-dd3c3abeabf0 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:03.927878 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c6d8fc5c-8243-43e3-8275-dd3c3abeabf0 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:03.936535 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-c6d8fc5c-8243-43e3-8275-dd3c3abeabf0 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1358 microversion: 2.1 time: 0.159708 Aug 24 17:59:03.937102 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 547/1096] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:03 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:04.958854 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-cb9dbe4d-44d5-4062-935e-4190d6e382e1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:04.959476 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-cb9dbe4d-44d5-4062-935e-4190d6e382e1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:04.966721 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cb9dbe4d-44d5-4062-935e-4190d6e382e1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:04.967199 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cb9dbe4d-44d5-4062-935e-4190d6e382e1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:04.967631 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cb9dbe4d-44d5-4062-935e-4190d6e382e1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:04.968325 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cb9dbe4d-44d5-4062-935e-4190d6e382e1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:04.968781 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cb9dbe4d-44d5-4062-935e-4190d6e382e1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:04.969209 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-cb9dbe4d-44d5-4062-935e-4190d6e382e1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:05.279688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-cb9dbe4d-44d5-4062-935e-4190d6e382e1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:05.287306 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-cb9dbe4d-44d5-4062-935e-4190d6e382e1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1548 microversion: 2.1 time: 0.332505 Aug 24 17:59:05.287866 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 550/1097] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:04 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1548 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:59:05.307886 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-3620dcfb-ecce-4d56-a6ae-919671453f07 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:05.308503 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-3620dcfb-ecce-4d56-a6ae-919671453f07 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:05.314923 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3620dcfb-ecce-4d56-a6ae-919671453f07 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:05.319911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3620dcfb-ecce-4d56-a6ae-919671453f07 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:05.319911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3620dcfb-ecce-4d56-a6ae-919671453f07 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:05.319911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3620dcfb-ecce-4d56-a6ae-919671453f07 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:05.319911 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3620dcfb-ecce-4d56-a6ae-919671453f07 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:05.320386 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3620dcfb-ecce-4d56-a6ae-919671453f07 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:05.451182 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-3620dcfb-ecce-4d56-a6ae-919671453f07 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:05.459208 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-3620dcfb-ecce-4d56-a6ae-919671453f07 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1548 microversion: 2.1 time: 0.155406 Aug 24 17:59:05.459775 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 548/1098] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:05 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:05.479689 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-50696653-23a5-4670-946a-c7ffade98070 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:05.484549 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-50696653-23a5-4670-946a-c7ffade98070 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:05.485301 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-50696653-23a5-4670-946a-c7ffade98070 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Searching by: {'deleted': False, 'project_id': '193c5ec786e74f138b2fc58ab35367ff'} {{(pid=127677) get_all /opt/stack/nova/nova/compute/api.py:3015}} Aug 24 17:59:05.491989 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-50696653-23a5-4670-946a-c7ffade98070 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:05.492457 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-50696653-23a5-4670-946a-c7ffade98070 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:05.492886 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-50696653-23a5-4670-946a-c7ffade98070 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:05.493599 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-50696653-23a5-4670-946a-c7ffade98070 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:05.494762 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-50696653-23a5-4670-946a-c7ffade98070 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:05.495311 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-50696653-23a5-4670-946a-c7ffade98070 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:05.590697 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.multi_cell_list [None req-50696653-23a5-4670-946a-c7ffade98070 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127677) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 17:59:05.686764 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-50696653-23a5-4670-946a-c7ffade98070 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.211565 Aug 24 17:59:05.687343 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 551/1099] 10.222.0.76 () {58 vars in 1125 bytes} [Wed Aug 24 17:59:05 2022] GET /compute/v2.1/servers => generated 342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:59:05.699257 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e29ca92c-b26f-4c7a-9a4e-11c366722402 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:05.699807 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e29ca92c-b26f-4c7a-9a4e-11c366722402 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:05.705825 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e29ca92c-b26f-4c7a-9a4e-11c366722402 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:05.706322 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e29ca92c-b26f-4c7a-9a4e-11c366722402 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:05.706762 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e29ca92c-b26f-4c7a-9a4e-11c366722402 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:05.707455 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e29ca92c-b26f-4c7a-9a4e-11c366722402 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:05.707919 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e29ca92c-b26f-4c7a-9a4e-11c366722402 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:05.708344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e29ca92c-b26f-4c7a-9a4e-11c366722402 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:05.890030 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-e29ca92c-b26f-4c7a-9a4e-11c366722402 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:05.897878 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e29ca92c-b26f-4c7a-9a4e-11c366722402 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1548 microversion: 2.1 time: 0.203284 Aug 24 17:59:05.898466 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 549/1100] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:05 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1548 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:07.785531 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-5a0331aa-83bc-4336-8a6a-0fb5c22fe150 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9b11fb4-60eb-44f0-973e-9631ef09c38e"}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:59:07.787887 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-5a0331aa-83bc-4336-8a6a-0fb5c22fe150 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:07.794761 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5a0331aa-83bc-4336-8a6a-0fb5c22fe150 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:07.795247 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5a0331aa-83bc-4336-8a6a-0fb5c22fe150 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:07.795681 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5a0331aa-83bc-4336-8a6a-0fb5c22fe150 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:07.796415 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5a0331aa-83bc-4336-8a6a-0fb5c22fe150 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:07.796874 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5a0331aa-83bc-4336-8a6a-0fb5c22fe150 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:07.797301 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5a0331aa-83bc-4336-8a6a-0fb5c22fe150 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:08.541294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-5a0331aa-83bc-4336-8a6a-0fb5c22fe150 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "POST /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.759238 Aug 24 17:59:08.541966 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 552/1101] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 17:59:07 2022] POST /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f/os-volume_attachments => generated 194 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:59:16.119781 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-285e55c9-eb93-4428-94c9-47de4ebb9ca1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:16.120393 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-285e55c9-eb93-4428-94c9-47de4ebb9ca1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:16.122996 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:59:16.123830 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=68 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:59:16.128366 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-285e55c9-eb93-4428-94c9-47de4ebb9ca1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:16.128853 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-285e55c9-eb93-4428-94c9-47de4ebb9ca1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:16.133132 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-285e55c9-eb93-4428-94c9-47de4ebb9ca1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:16.133132 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-285e55c9-eb93-4428-94c9-47de4ebb9ca1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:16.133132 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-285e55c9-eb93-4428-94c9-47de4ebb9ca1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:16.133132 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-285e55c9-eb93-4428-94c9-47de4ebb9ca1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:16.268500 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-285e55c9-eb93-4428-94c9-47de4ebb9ca1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:16.277310 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-285e55c9-eb93-4428-94c9-47de4ebb9ca1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1594 microversion: 2.1 time: 0.161370 Aug 24 17:59:16.278165 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 550/1102] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:16 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1594 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:18.490577 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-74071ac3-286c-4261-be5f-40a1ce6e2a81 req-ab8c1dd6-b519-4516-8808-698d2baef4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f", "tag": "aa39e6f6-d4ec-40b7-ab96-a41e7d6771ff"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:59:18.496765 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=2 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:59:18.497711 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:59:18.498392 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:59:18.503867 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-74071ac3-286c-4261-be5f-40a1ce6e2a81 req-ab8c1dd6-b519-4516-8808-698d2baef4c7 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:18.512807 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-74071ac3-286c-4261-be5f-40a1ce6e2a81 req-ab8c1dd6-b519-4516-8808-698d2baef4c7 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:18.512807 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-74071ac3-286c-4261-be5f-40a1ce6e2a81 req-ab8c1dd6-b519-4516-8808-698d2baef4c7 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:18.516662 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-74071ac3-286c-4261-be5f-40a1ce6e2a81 req-ab8c1dd6-b519-4516-8808-698d2baef4c7 service nova] Creating event network-changed:aa39e6f6-d4ec-40b7-ab96-a41e7d6771ff for instance 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f on hv-cinder-85442 Aug 24 17:59:18.521720 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-74071ac3-286c-4261-be5f-40a1ce6e2a81 req-ab8c1dd6-b519-4516-8808-698d2baef4c7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035117 Aug 24 17:59:18.522416 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 553/1103] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:59:20.990235 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-33d6957d-bd35-4342-ab2e-967e749d06de tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-79739178"}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:59:20.990792 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-33d6957d-bd35-4342-ab2e-967e749d06de tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:20.998105 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-33d6957d-bd35-4342-ab2e-967e749d06de tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:21.003217 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-33d6957d-bd35-4342-ab2e-967e749d06de tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:21.003217 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-33d6957d-bd35-4342-ab2e-967e749d06de tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:21.003217 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-33d6957d-bd35-4342-ab2e-967e749d06de tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:21.003217 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-33d6957d-bd35-4342-ab2e-967e749d06de tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:21.003663 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-33d6957d-bd35-4342-ab2e-967e749d06de tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:21.134861 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.network.security_group_api [None req-33d6957d-bd35-4342-ab2e-967e749d06de tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Adding security group d3359091-90ce-43fa-9115-1b1ead0f645c to port aa39e6f6-d4ec-40b7-ab96-a41e7d6771ff Aug 24 17:59:21.520916 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-33d6957d-bd35-4342-ab2e-967e749d06de tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "POST /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f/action" status: 202 len: 0 microversion: 2.1 time: 0.534871 Aug 24 17:59:21.521510 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 551/1104] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 17:59:20 2022] POST /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:59:21.530449 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-3f43ef73-81b4-4f40-8c9d-a0c222323c07 req-aefb39fe-d1a4-424c-8e6e-568013fa85e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f", "tag": "aa39e6f6-d4ec-40b7-ab96-a41e7d6771ff"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:59:21.532765 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-388d84c0-84af-46dd-889a-c494256b6d39 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:21.533585 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-388d84c0-84af-46dd-889a-c494256b6d39 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:21.541813 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-3f43ef73-81b4-4f40-8c9d-a0c222323c07 req-aefb39fe-d1a4-424c-8e6e-568013fa85e3 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:21.542643 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-3f43ef73-81b4-4f40-8c9d-a0c222323c07 req-aefb39fe-d1a4-424c-8e6e-568013fa85e3 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:21.542790 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-388d84c0-84af-46dd-889a-c494256b6d39 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:21.543416 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-388d84c0-84af-46dd-889a-c494256b6d39 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:21.543554 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-3f43ef73-81b4-4f40-8c9d-a0c222323c07 req-aefb39fe-d1a4-424c-8e6e-568013fa85e3 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:21.544034 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-388d84c0-84af-46dd-889a-c494256b6d39 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:21.544904 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-388d84c0-84af-46dd-889a-c494256b6d39 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:21.545661 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-388d84c0-84af-46dd-889a-c494256b6d39 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:21.546361 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-388d84c0-84af-46dd-889a-c494256b6d39 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:21.561363 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-3f43ef73-81b4-4f40-8c9d-a0c222323c07 req-aefb39fe-d1a4-424c-8e6e-568013fa85e3 service nova] Creating event network-changed:aa39e6f6-d4ec-40b7-ab96-a41e7d6771ff for instance 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f on hv-cinder-85442 Aug 24 17:59:21.568680 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-3f43ef73-81b4-4f40-8c9d-a0c222323c07 req-aefb39fe-d1a4-424c-8e6e-568013fa85e3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041738 Aug 24 17:59:21.570312 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 552/1105] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:59:21.808954 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-388d84c0-84af-46dd-889a-c494256b6d39 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:21.818781 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-388d84c0-84af-46dd-889a-c494256b6d39 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1757 microversion: 2.1 time: 0.292027 Aug 24 17:59:21.820154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 554/1106] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:21 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1757 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:22.946049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:59:22.947472 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Wed Aug 24 17:59:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:59:38.849498 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=6 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:59:38.850286 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=12 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:59:38.855168 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-592c3d2a-d6d6-4cd4-976e-6c8daf87d5dd tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:59:38.857432 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-592c3d2a-d6d6-4cd4-976e-6c8daf87d5dd tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:38.863513 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-592c3d2a-d6d6-4cd4-976e-6c8daf87d5dd tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:38.864879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-592c3d2a-d6d6-4cd4-976e-6c8daf87d5dd tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:38.864879 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-592c3d2a-d6d6-4cd4-976e-6c8daf87d5dd tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:38.865170 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-592c3d2a-d6d6-4cd4-976e-6c8daf87d5dd tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:38.865584 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-592c3d2a-d6d6-4cd4-976e-6c8daf87d5dd tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:38.866046 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-592c3d2a-d6d6-4cd4-976e-6c8daf87d5dd tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:39.073495 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-592c3d2a-d6d6-4cd4-976e-6c8daf87d5dd tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "POST /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f/action" status: 202 len: 0 microversion: 2.1 time: 0.225187 Aug 24 17:59:39.074463 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 553/1107] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 17:59:38 2022] POST /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:59:39.082435 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-46d9d798-d351-4920-9509-705d32e9ccb4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:39.083059 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-46d9d798-d351-4920-9509-705d32e9ccb4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:39.086659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=4 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:59:39.087934 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=8 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:59:39.092061 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46d9d798-d351-4920-9509-705d32e9ccb4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:39.092552 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46d9d798-d351-4920-9509-705d32e9ccb4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:39.092998 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46d9d798-d351-4920-9509-705d32e9ccb4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:39.093701 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46d9d798-d351-4920-9509-705d32e9ccb4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:39.094225 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46d9d798-d351-4920-9509-705d32e9ccb4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:39.094686 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-46d9d798-d351-4920-9509-705d32e9ccb4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:39.252106 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-46d9d798-d351-4920-9509-705d32e9ccb4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:39.261304 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-46d9d798-d351-4920-9509-705d32e9ccb4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1749 microversion: 2.1 time: 0.182607 Aug 24 17:59:39.261889 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 555/1108] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:39 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1749 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:40.283340 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-20f46b7c-1f60-44e7-a35c-130ffec018da tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:40.284041 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-20f46b7c-1f60-44e7-a35c-130ffec018da tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:40.290220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-20f46b7c-1f60-44e7-a35c-130ffec018da tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:40.291232 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-20f46b7c-1f60-44e7-a35c-130ffec018da tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:40.291782 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-20f46b7c-1f60-44e7-a35c-130ffec018da tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:40.292480 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-20f46b7c-1f60-44e7-a35c-130ffec018da tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:40.292935 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-20f46b7c-1f60-44e7-a35c-130ffec018da tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:40.293402 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-20f46b7c-1f60-44e7-a35c-130ffec018da tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:40.437415 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-20f46b7c-1f60-44e7-a35c-130ffec018da tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:40.445882 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-20f46b7c-1f60-44e7-a35c-130ffec018da tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1754 microversion: 2.1 time: 0.167247 Aug 24 17:59:40.446464 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 554/1109] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:40 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:41.467580 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0065ca8e-6e6e-4d75-aebc-47a257fac8d4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:41.468177 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0065ca8e-6e6e-4d75-aebc-47a257fac8d4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:41.474596 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0065ca8e-6e6e-4d75-aebc-47a257fac8d4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:41.475071 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0065ca8e-6e6e-4d75-aebc-47a257fac8d4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:41.475497 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0065ca8e-6e6e-4d75-aebc-47a257fac8d4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:41.476172 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0065ca8e-6e6e-4d75-aebc-47a257fac8d4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:41.476613 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0065ca8e-6e6e-4d75-aebc-47a257fac8d4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:41.477030 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0065ca8e-6e6e-4d75-aebc-47a257fac8d4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:41.623828 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0065ca8e-6e6e-4d75-aebc-47a257fac8d4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:41.632012 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0065ca8e-6e6e-4d75-aebc-47a257fac8d4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1754 microversion: 2.1 time: 0.168296 Aug 24 17:59:41.632573 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 556/1110] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:41 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:42.653829 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-451ac958-1998-4b2f-b4eb-3285763e88ab tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:42.654389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-451ac958-1998-4b2f-b4eb-3285763e88ab tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:42.660793 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-451ac958-1998-4b2f-b4eb-3285763e88ab tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:42.661280 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-451ac958-1998-4b2f-b4eb-3285763e88ab tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:42.661722 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-451ac958-1998-4b2f-b4eb-3285763e88ab tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:42.662445 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-451ac958-1998-4b2f-b4eb-3285763e88ab tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:42.662905 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-451ac958-1998-4b2f-b4eb-3285763e88ab tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:42.663335 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-451ac958-1998-4b2f-b4eb-3285763e88ab tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:42.812618 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-451ac958-1998-4b2f-b4eb-3285763e88ab tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:42.820780 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-451ac958-1998-4b2f-b4eb-3285763e88ab tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1754 microversion: 2.1 time: 0.170965 Aug 24 17:59:42.821409 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 555/1111] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:42 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:43.843218 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c61e8894-ff07-456c-9994-a72fbc54fa2f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:43.843908 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c61e8894-ff07-456c-9994-a72fbc54fa2f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:43.850445 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c61e8894-ff07-456c-9994-a72fbc54fa2f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:43.850929 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c61e8894-ff07-456c-9994-a72fbc54fa2f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:43.851365 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c61e8894-ff07-456c-9994-a72fbc54fa2f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:43.852053 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c61e8894-ff07-456c-9994-a72fbc54fa2f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:43.852509 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c61e8894-ff07-456c-9994-a72fbc54fa2f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:43.854020 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c61e8894-ff07-456c-9994-a72fbc54fa2f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:43.997915 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c61e8894-ff07-456c-9994-a72fbc54fa2f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:44.006422 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c61e8894-ff07-456c-9994-a72fbc54fa2f tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1754 microversion: 2.1 time: 0.167108 Aug 24 17:59:44.006988 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 557/1112] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:43 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:45.029285 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-6b1ed60e-e1b4-43ef-9f0c-f2d90dfcf44a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:45.029917 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-6b1ed60e-e1b4-43ef-9f0c-f2d90dfcf44a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:45.036235 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6b1ed60e-e1b4-43ef-9f0c-f2d90dfcf44a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:45.036710 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6b1ed60e-e1b4-43ef-9f0c-f2d90dfcf44a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:45.037139 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6b1ed60e-e1b4-43ef-9f0c-f2d90dfcf44a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:45.037817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6b1ed60e-e1b4-43ef-9f0c-f2d90dfcf44a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:45.038293 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6b1ed60e-e1b4-43ef-9f0c-f2d90dfcf44a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:45.038750 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-6b1ed60e-e1b4-43ef-9f0c-f2d90dfcf44a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:45.188241 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-6b1ed60e-e1b4-43ef-9f0c-f2d90dfcf44a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:45.196452 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-6b1ed60e-e1b4-43ef-9f0c-f2d90dfcf44a tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1754 microversion: 2.1 time: 0.171374 Aug 24 17:59:45.197378 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 556/1113] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:45 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:46.217259 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-bc8c7abc-abac-494c-bf77-ee6d78f3c19c tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:46.217910 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-bc8c7abc-abac-494c-bf77-ee6d78f3c19c tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:46.224290 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bc8c7abc-abac-494c-bf77-ee6d78f3c19c tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:46.224769 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bc8c7abc-abac-494c-bf77-ee6d78f3c19c tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:46.225200 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bc8c7abc-abac-494c-bf77-ee6d78f3c19c tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:46.225916 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bc8c7abc-abac-494c-bf77-ee6d78f3c19c tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:46.226371 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bc8c7abc-abac-494c-bf77-ee6d78f3c19c tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:46.226791 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-bc8c7abc-abac-494c-bf77-ee6d78f3c19c tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:46.373431 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-bc8c7abc-abac-494c-bf77-ee6d78f3c19c tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:46.381693 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-bc8c7abc-abac-494c-bf77-ee6d78f3c19c tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1754 microversion: 2.1 time: 0.168445 Aug 24 17:59:46.382275 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 558/1114] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:46 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:47.403654 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0e5e95a4-b8ea-4421-9fef-3d5d842e8349 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:47.404275 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0e5e95a4-b8ea-4421-9fef-3d5d842e8349 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:47.410261 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0e5e95a4-b8ea-4421-9fef-3d5d842e8349 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:47.410789 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0e5e95a4-b8ea-4421-9fef-3d5d842e8349 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:47.411232 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0e5e95a4-b8ea-4421-9fef-3d5d842e8349 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:47.411948 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0e5e95a4-b8ea-4421-9fef-3d5d842e8349 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:47.412411 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0e5e95a4-b8ea-4421-9fef-3d5d842e8349 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:47.412839 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0e5e95a4-b8ea-4421-9fef-3d5d842e8349 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:47.559414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0e5e95a4-b8ea-4421-9fef-3d5d842e8349 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:47.567855 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0e5e95a4-b8ea-4421-9fef-3d5d842e8349 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1754 microversion: 2.1 time: 0.168321 Aug 24 17:59:47.568424 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 557/1115] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:47 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:48.590707 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3903d299-13fa-4bfd-a0d5-d53625db56e2 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:48.591352 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3903d299-13fa-4bfd-a0d5-d53625db56e2 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:48.597756 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3903d299-13fa-4bfd-a0d5-d53625db56e2 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:48.598308 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3903d299-13fa-4bfd-a0d5-d53625db56e2 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:48.598742 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3903d299-13fa-4bfd-a0d5-d53625db56e2 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:48.599425 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3903d299-13fa-4bfd-a0d5-d53625db56e2 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:48.599878 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3903d299-13fa-4bfd-a0d5-d53625db56e2 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:48.600301 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3903d299-13fa-4bfd-a0d5-d53625db56e2 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:48.745151 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-3903d299-13fa-4bfd-a0d5-d53625db56e2 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:48.753296 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3903d299-13fa-4bfd-a0d5-d53625db56e2 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1754 microversion: 2.1 time: 0.167314 Aug 24 17:59:48.753882 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 559/1116] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:48 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:49.775420 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-74649872-fbe7-4942-8933-95fe6214a226 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:49.776034 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-74649872-fbe7-4942-8933-95fe6214a226 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:49.784349 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-74649872-fbe7-4942-8933-95fe6214a226 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:49.785230 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-74649872-fbe7-4942-8933-95fe6214a226 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:49.786013 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-74649872-fbe7-4942-8933-95fe6214a226 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:49.787226 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-74649872-fbe7-4942-8933-95fe6214a226 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:49.788048 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-74649872-fbe7-4942-8933-95fe6214a226 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:49.788821 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-74649872-fbe7-4942-8933-95fe6214a226 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:49.938556 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-74649872-fbe7-4942-8933-95fe6214a226 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:49.947488 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-74649872-fbe7-4942-8933-95fe6214a226 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1754 microversion: 2.1 time: 0.176772 Aug 24 17:59:49.955191 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 558/1117] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:49 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:50.968784 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-c25107d5-ec99-4495-ad6e-b1169b8c5bbc tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:50.969488 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-c25107d5-ec99-4495-ad6e-b1169b8c5bbc tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:50.976115 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c25107d5-ec99-4495-ad6e-b1169b8c5bbc tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:50.976631 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c25107d5-ec99-4495-ad6e-b1169b8c5bbc tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:50.977069 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c25107d5-ec99-4495-ad6e-b1169b8c5bbc tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:50.978605 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c25107d5-ec99-4495-ad6e-b1169b8c5bbc tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:50.979213 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c25107d5-ec99-4495-ad6e-b1169b8c5bbc tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:50.979649 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-c25107d5-ec99-4495-ad6e-b1169b8c5bbc tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:51.129458 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-c25107d5-ec99-4495-ad6e-b1169b8c5bbc tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:51.138704 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-c25107d5-ec99-4495-ad6e-b1169b8c5bbc tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1754 microversion: 2.1 time: 0.173798 Aug 24 17:59:51.139754 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 560/1118] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:50 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:51.282201 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-23d08326-94e8-4c23-a790-b868b5762712 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:51.282201 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-23d08326-94e8-4c23-a790-b868b5762712 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:51.289416 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-23d08326-94e8-4c23-a790-b868b5762712 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:51.290695 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-23d08326-94e8-4c23-a790-b868b5762712 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:51.291311 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-23d08326-94e8-4c23-a790-b868b5762712 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:51.292017 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-23d08326-94e8-4c23-a790-b868b5762712 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:51.292476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-23d08326-94e8-4c23-a790-b868b5762712 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:51.292909 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-23d08326-94e8-4c23-a790-b868b5762712 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:51.323460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-23d08326-94e8-4c23-a790-b868b5762712 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Going to try to terminate instance {{(pid=127676) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:59:51.347141 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-f8c63984-f67c-4e50-a7bb-6524115d1e62 req-ab330bf6-81b0-41e7-a7be-e2a7d2ba838c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69505209-dd3b-400e-a4d9-1bf3d7f3af32", "tag": "5d68095a-7771-47f5-8f50-318fc40b06a0"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:59:51.359225 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-f8c63984-f67c-4e50-a7bb-6524115d1e62 req-ab330bf6-81b0-41e7-a7be-e2a7d2ba838c service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:51.360115 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-f8c63984-f67c-4e50-a7bb-6524115d1e62 req-ab330bf6-81b0-41e7-a7be-e2a7d2ba838c service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:51.360722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-f8c63984-f67c-4e50-a7bb-6524115d1e62 req-ab330bf6-81b0-41e7-a7be-e2a7d2ba838c service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:51.372884 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-f8c63984-f67c-4e50-a7bb-6524115d1e62 req-ab330bf6-81b0-41e7-a7be-e2a7d2ba838c service nova] Creating event network-changed:5d68095a-7771-47f5-8f50-318fc40b06a0 for instance 69505209-dd3b-400e-a4d9-1bf3d7f3af32 on hv-cinder-85442 Aug 24 17:59:51.379950 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-f8c63984-f67c-4e50-a7bb-6524115d1e62 req-ab330bf6-81b0-41e7-a7be-e2a7d2ba838c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099085 Aug 24 17:59:51.379950 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 561/1119] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:59:51.646315 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-23d08326-94e8-4c23-a790-b868b5762712 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "DELETE /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 204 len: 0 microversion: 2.1 time: 0.369503 Aug 24 17:59:51.651157 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 559/1120] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:59:51 2022] DELETE /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:59:51.656709 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-287b4d35-c122-4aa1-b717-714d42c0c22e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:51.657410 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-287b4d35-c122-4aa1-b717-714d42c0c22e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:51.663810 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-287b4d35-c122-4aa1-b717-714d42c0c22e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:51.664290 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-287b4d35-c122-4aa1-b717-714d42c0c22e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:51.664717 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-287b4d35-c122-4aa1-b717-714d42c0c22e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:51.666006 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-287b4d35-c122-4aa1-b717-714d42c0c22e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:51.666639 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-287b4d35-c122-4aa1-b717-714d42c0c22e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:51.667066 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-287b4d35-c122-4aa1-b717-714d42c0c22e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:51.804193 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-287b4d35-c122-4aa1-b717-714d42c0c22e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:51.812822 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-287b4d35-c122-4aa1-b717-714d42c0c22e tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1579 microversion: 2.1 time: 0.160311 Aug 24 17:59:51.813382 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 562/1121] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:51 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:52.161214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-8852232c-4a75-4365-8e9c-07008f364c62 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:52.161827 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-8852232c-4a75-4365-8e9c-07008f364c62 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:52.168465 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8852232c-4a75-4365-8e9c-07008f364c62 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:52.168948 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8852232c-4a75-4365-8e9c-07008f364c62 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:52.169383 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8852232c-4a75-4365-8e9c-07008f364c62 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:52.170116 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8852232c-4a75-4365-8e9c-07008f364c62 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:52.170568 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8852232c-4a75-4365-8e9c-07008f364c62 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:52.170990 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-8852232c-4a75-4365-8e9c-07008f364c62 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:52.325750 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-8852232c-4a75-4365-8e9c-07008f364c62 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:52.334178 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-8852232c-4a75-4365-8e9c-07008f364c62 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1757 microversion: 2.1 time: 0.177242 Aug 24 17:59:52.334746 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 560/1122] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:52 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:52.833878 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f1d13a35-a486-4b1c-bb3d-81362be451fd tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:52.834496 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-f1d13a35-a486-4b1c-bb3d-81362be451fd tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:52.841779 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f1d13a35-a486-4b1c-bb3d-81362be451fd tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:52.842305 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f1d13a35-a486-4b1c-bb3d-81362be451fd tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:52.842771 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f1d13a35-a486-4b1c-bb3d-81362be451fd tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:52.843473 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f1d13a35-a486-4b1c-bb3d-81362be451fd tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:52.843932 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f1d13a35-a486-4b1c-bb3d-81362be451fd tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:52.844369 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f1d13a35-a486-4b1c-bb3d-81362be451fd tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:52.986667 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f1d13a35-a486-4b1c-bb3d-81362be451fd tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:52.994459 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-f1d13a35-a486-4b1c-bb3d-81362be451fd tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1579 microversion: 2.1 time: 0.164515 Aug 24 17:59:52.995782 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 563/1123] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:52 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:59:54.017028 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b3a7d77f-8891-4f19-af1a-4d61aa25574b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:54.017750 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-b3a7d77f-8891-4f19-af1a-4d61aa25574b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:54.022366 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-f66f70ce-a938-492d-9d48-825a8bae2cc5 req-bf893848-4959-4472-a130-c888a93ad4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69505209-dd3b-400e-a4d9-1bf3d7f3af32", "name": "network-vif-deleted", "tag": "5d68095a-7771-47f5-8f50-318fc40b06a0"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:59:54.024308 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b3a7d77f-8891-4f19-af1a-4d61aa25574b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:54.024855 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b3a7d77f-8891-4f19-af1a-4d61aa25574b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:54.025356 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b3a7d77f-8891-4f19-af1a-4d61aa25574b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:54.027027 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b3a7d77f-8891-4f19-af1a-4d61aa25574b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:54.027732 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b3a7d77f-8891-4f19-af1a-4d61aa25574b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:54.028221 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b3a7d77f-8891-4f19-af1a-4d61aa25574b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:54.033813 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-f66f70ce-a938-492d-9d48-825a8bae2cc5 req-bf893848-4959-4472-a130-c888a93ad4b0 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:54.034330 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-f66f70ce-a938-492d-9d48-825a8bae2cc5 req-bf893848-4959-4472-a130-c888a93ad4b0 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:54.034773 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-f66f70ce-a938-492d-9d48-825a8bae2cc5 req-bf893848-4959-4472-a130-c888a93ad4b0 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:54.047149 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-f66f70ce-a938-492d-9d48-825a8bae2cc5 req-bf893848-4959-4472-a130-c888a93ad4b0 service nova] Creating event network-vif-deleted:5d68095a-7771-47f5-8f50-318fc40b06a0 for instance 69505209-dd3b-400e-a4d9-1bf3d7f3af32 on hv-cinder-85442 Aug 24 17:59:54.052371 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-f66f70ce-a938-492d-9d48-825a8bae2cc5 req-bf893848-4959-4472-a130-c888a93ad4b0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033612 Aug 24 17:59:54.052980 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 564/1124] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:59:54.096599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b3a7d77f-8891-4f19-af1a-4d61aa25574b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:54.104772 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b3a7d77f-8891-4f19-af1a-4d61aa25574b tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1393 microversion: 2.1 time: 0.092714 Aug 24 17:59:54.105357 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 561/1125] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:54 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1393 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:55.127519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-f633c746-9e19-40d4-9486-91601d1fbf88 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:55.128210 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-f633c746-9e19-40d4-9486-91601d1fbf88 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:55.134836 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f633c746-9e19-40d4-9486-91601d1fbf88 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:55.135331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f633c746-9e19-40d4-9486-91601d1fbf88 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:55.136417 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f633c746-9e19-40d4-9486-91601d1fbf88 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:55.137278 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f633c746-9e19-40d4-9486-91601d1fbf88 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:55.137725 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f633c746-9e19-40d4-9486-91601d1fbf88 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:55.138169 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f633c746-9e19-40d4-9486-91601d1fbf88 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:55.170751 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f633c746-9e19-40d4-9486-91601d1fbf88 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:55.171201 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f633c746-9e19-40d4-9486-91601d1fbf88 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:55.171640 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-f633c746-9e19-40d4-9486-91601d1fbf88 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:55.172087 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.objects.instance [None req-f633c746-9e19-40d4-9486-91601d1fbf88 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lazy-loading 'fault' on Instance uuid 69505209-dd3b-400e-a4d9-1bf3d7f3af32 {{(pid=127677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:59:55.215347 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-f633c746-9e19-40d4-9486-91601d1fbf88 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:55.223313 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-f633c746-9e19-40d4-9486-91601d1fbf88 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 200 len: 1231 microversion: 2.1 time: 0.100504 Aug 24 17:59:55.223886 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 565/1126] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:55 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 1231 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:56.244669 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d38b43be-e8f4-4b89-813a-978f0bdc0549 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:56.259968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d38b43be-e8f4-4b89-813a-978f0bdc0549 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 69505209-dd3b-400e-a4d9-1bf3d7f3af32] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:56.259968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d38b43be-e8f4-4b89-813a-978f0bdc0549 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:56.259968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d38b43be-e8f4-4b89-813a-978f0bdc0549 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:56.259968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d38b43be-e8f4-4b89-813a-978f0bdc0549 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:56.260466 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d38b43be-e8f4-4b89-813a-978f0bdc0549 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:56.260466 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d38b43be-e8f4-4b89-813a-978f0bdc0549 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:56.260466 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d38b43be-e8f4-4b89-813a-978f0bdc0549 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:56.269445 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-d38b43be-e8f4-4b89-813a-978f0bdc0549 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] HTTP exception thrown: Instance 69505209-dd3b-400e-a4d9-1bf3d7f3af32 could not be found. Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d38b43be-e8f4-4b89-813a-978f0bdc0549 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Request method failure captured: Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 HTTP/1.1 Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmVA6wpgWgaeWvIIIWR-Jnwuaby9_LW__hON31Wmek0wwA_G9g0PcV8zZD3Ov7jBKLDqlxceRmll4WtLGzInSNHsIgXEU7V2yvuqfcZdtzTnh57HfCEIW3f8Bd3Rh4vUpggBSYTaN_W7YjICamzEPDRiyKwLqJFKIDR64uO2kEoLkKg Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 54cebab3bf1f440dbaa4ef020177a4bb Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-TestVolumeBootPattern-1322010073 Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 17:59:56.271161 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 17:59:56.272820 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/54cebab3bf1f440dbaa4ef020177a4bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/54cebab3bf1f440dbaa4ef020177a4bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_54cebab3bf1f440dbaa4ef020177a4bb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/54cebab3bf1f440dbaa4ef020177a4bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 17:59:56.272820 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-TestVolumeBootPattern-1322010073 Aug 24 17:59:56.272820 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 54cebab3bf1f440dbaa4ef020177a4bb Aug 24 17:59:56.272820 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-TestVolumeBootPattern-1322010073 Aug 24 17:59:56.272820 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-TestVolumeBootPattern-1322010073-project Aug 24 17:59:56.272820 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 17:59:56.272820 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 17:59:56.272820 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: f19bf0e6a8ad425cbbf804d6d7be5a0a Aug 24 17:59:56.272820 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-TestVolumeBootPattern-1322010073-project Aug 24 17:59:56.272820 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 17:59:56.272820 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance 69505209-dd3b-400e-a4d9-1bf3d7f3af32 could not be found. Aug 24 17:59:56.272820 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': '69505209-dd3b-400e-a4d9-1bf3d7f3af32'} Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69505209-dd3b-400e-a4d9-1bf3d7f3af32 could not be found. Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:59:56.273975 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:59:56.275551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:59:56.275551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:59:56.275551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:59:56.275551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:59:56.275551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:59:56.275551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:59:56.275551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:59:56.275551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69505209-dd3b-400e-a4d9-1bf3d7f3af32 could not be found. Aug 24 17:59:56.275551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:59:56.275551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:59:56.275551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:59:56.275551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:59:56.275551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:59:56.275551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:59:56.275551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:59:56.275551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:59:56.275551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69505209-dd3b-400e-a4d9-1bf3d7f3af32 could not be found. Aug 24 17:59:56.275551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 17:59:56.277702 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d38b43be-e8f4-4b89-813a-978f0bdc0549 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Returning 404 to user: Instance 69505209-dd3b-400e-a4d9-1bf3d7f3af32 could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:59:56.277702 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d38b43be-e8f4-4b89-813a-978f0bdc0549 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32" status: 404 len: 111 microversion: 2.1 time: 0.031834 Aug 24 17:59:56.277702 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 562/1127] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:56 2022] GET /compute/v2.1/servers/69505209-dd3b-400e-a4d9-1bf3d7f3af32 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:59:59.681951 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-6ed6f8dc-035e-4466-aaa6-bbe08b93646b req-84cae714-7c77-4f8e-bbdb-582663d46937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa9d4f71-3435-4fe1-94c1-3c2aa90852e0", "tag": "a5b4bf67-96d5-4f27-af69-f55896b0c827"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:59:59.682616 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-638597a7-bbae-484e-b69c-962c6ac4e046 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:59.686756 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-638597a7-bbae-484e-b69c-962c6ac4e046 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:59.691208 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-638597a7-bbae-484e-b69c-962c6ac4e046 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:59.691694 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-638597a7-bbae-484e-b69c-962c6ac4e046 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:59.692127 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-638597a7-bbae-484e-b69c-962c6ac4e046 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:59.692752 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-6ed6f8dc-035e-4466-aaa6-bbe08b93646b req-84cae714-7c77-4f8e-bbdb-582663d46937 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:59.692918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-638597a7-bbae-484e-b69c-962c6ac4e046 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:59.693256 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-6ed6f8dc-035e-4466-aaa6-bbe08b93646b req-84cae714-7c77-4f8e-bbdb-582663d46937 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:59.693451 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-638597a7-bbae-484e-b69c-962c6ac4e046 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:59.693632 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-6ed6f8dc-035e-4466-aaa6-bbe08b93646b req-84cae714-7c77-4f8e-bbdb-582663d46937 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:59.693845 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-638597a7-bbae-484e-b69c-962c6ac4e046 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:59.710950 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-6ed6f8dc-035e-4466-aaa6-bbe08b93646b req-84cae714-7c77-4f8e-bbdb-582663d46937 service nova] Creating event network-changed:a5b4bf67-96d5-4f27-af69-f55896b0c827 for instance aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 on hv-cinder-85442 Aug 24 17:59:59.717567 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-6ed6f8dc-035e-4466-aaa6-bbe08b93646b req-84cae714-7c77-4f8e-bbdb-582663d46937 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039384 Aug 24 17:59:59.718609 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 563/1128] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 17:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:59:59.733689 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-638597a7-bbae-484e-b69c-962c6ac4e046 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Going to try to terminate instance {{(pid=127677) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 18:00:00.085775 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-638597a7-bbae-484e-b69c-962c6ac4e046 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "DELETE /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 204 len: 0 microversion: 2.1 time: 0.409251 Aug 24 18:00:00.089601 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 566/1129] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 17:59:59 2022] DELETE /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 18:00:00.095260 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-93e48c1b-1542-40ed-a9b2-688b749f80e5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:00.095967 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-93e48c1b-1542-40ed-a9b2-688b749f80e5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:00.111804 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-93e48c1b-1542-40ed-a9b2-688b749f80e5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:00.112312 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-93e48c1b-1542-40ed-a9b2-688b749f80e5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:00.112753 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-93e48c1b-1542-40ed-a9b2-688b749f80e5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:00.114145 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-93e48c1b-1542-40ed-a9b2-688b749f80e5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:00.114667 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-93e48c1b-1542-40ed-a9b2-688b749f80e5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:00.115118 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-93e48c1b-1542-40ed-a9b2-688b749f80e5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:00.257015 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-93e48c1b-1542-40ed-a9b2-688b749f80e5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:00:00.266435 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-93e48c1b-1542-40ed-a9b2-688b749f80e5 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1579 microversion: 2.1 time: 0.175445 Aug 24 18:00:00.267356 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 564/1130] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:00:00 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1579 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:00:01.288804 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e5a8e3aa-332d-406b-8007-3650c7deb310 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:01.293326 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-e5a8e3aa-332d-406b-8007-3650c7deb310 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:01.297427 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e5a8e3aa-332d-406b-8007-3650c7deb310 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:01.297951 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e5a8e3aa-332d-406b-8007-3650c7deb310 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:01.298446 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e5a8e3aa-332d-406b-8007-3650c7deb310 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:01.299214 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e5a8e3aa-332d-406b-8007-3650c7deb310 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:01.299671 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e5a8e3aa-332d-406b-8007-3650c7deb310 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:01.300101 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e5a8e3aa-332d-406b-8007-3650c7deb310 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:01.437271 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-e5a8e3aa-332d-406b-8007-3650c7deb310 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:00:01.445183 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-e5a8e3aa-332d-406b-8007-3650c7deb310 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1579 microversion: 2.1 time: 0.160593 Aug 24 18:00:01.448029 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 567/1131] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:00:01 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:00:02.244796 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-7487fa8f-b5d7-4545-9a2e-1a036b573eb2 req-69d05fde-366d-4db6-ae77-3479a6f7cce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa9d4f71-3435-4fe1-94c1-3c2aa90852e0", "name": "network-vif-deleted", "tag": "a5b4bf67-96d5-4f27-af69-f55896b0c827"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 18:00:02.255981 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-7487fa8f-b5d7-4545-9a2e-1a036b573eb2 req-69d05fde-366d-4db6-ae77-3479a6f7cce0 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:02.256666 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-7487fa8f-b5d7-4545-9a2e-1a036b573eb2 req-69d05fde-366d-4db6-ae77-3479a6f7cce0 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:02.257103 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-7487fa8f-b5d7-4545-9a2e-1a036b573eb2 req-69d05fde-366d-4db6-ae77-3479a6f7cce0 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:02.269129 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-7487fa8f-b5d7-4545-9a2e-1a036b573eb2 req-69d05fde-366d-4db6-ae77-3479a6f7cce0 service nova] Creating event network-vif-deleted:a5b4bf67-96d5-4f27-af69-f55896b0c827 for instance aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 on hv-cinder-85442 Aug 24 18:00:02.274413 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-7487fa8f-b5d7-4545-9a2e-1a036b573eb2 req-69d05fde-366d-4db6-ae77-3479a6f7cce0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033364 Aug 24 18:00:02.275008 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 565/1132] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 18:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 18:00:02.468406 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-89358558-74d2-429c-9001-9ed403bf9f96 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:02.469018 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-89358558-74d2-429c-9001-9ed403bf9f96 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:02.475514 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-89358558-74d2-429c-9001-9ed403bf9f96 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:02.475989 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-89358558-74d2-429c-9001-9ed403bf9f96 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:02.476418 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-89358558-74d2-429c-9001-9ed403bf9f96 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:02.477269 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-89358558-74d2-429c-9001-9ed403bf9f96 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:02.477726 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-89358558-74d2-429c-9001-9ed403bf9f96 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:02.478175 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-89358558-74d2-429c-9001-9ed403bf9f96 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:02.549294 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-89358558-74d2-429c-9001-9ed403bf9f96 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19bf0e6a8ad425cbbf804d6d7be5a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54cebab3bf1f440dbaa4ef020177a4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:00:02.557393 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-89358558-74d2-429c-9001-9ed403bf9f96 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 200 len: 1226 microversion: 2.1 time: 0.093815 Aug 24 18:00:02.558060 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 568/1133] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:00:02 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:00:03.580220 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a43a519f-eb69-4f04-98dd-41215bc824a3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:03.580828 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a43a519f-eb69-4f04-98dd-41215bc824a3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: aa9d4f71-3435-4fe1-94c1-3c2aa90852e0] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:03.587185 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a43a519f-eb69-4f04-98dd-41215bc824a3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:03.587658 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a43a519f-eb69-4f04-98dd-41215bc824a3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:03.588094 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a43a519f-eb69-4f04-98dd-41215bc824a3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:03.588772 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a43a519f-eb69-4f04-98dd-41215bc824a3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:03.590156 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a43a519f-eb69-4f04-98dd-41215bc824a3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:03.590626 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a43a519f-eb69-4f04-98dd-41215bc824a3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:03.603490 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-a43a519f-eb69-4f04-98dd-41215bc824a3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] HTTP exception thrown: Instance aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 could not be found. Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a43a519f-eb69-4f04-98dd-41215bc824a3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Request method failure captured: Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 HTTP/1.1 Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmVA6wpgWgaeWvIIIWR-Jnwuaby9_LW__hON31Wmek0wwA_G9g0PcV8zZD3Ov7jBKLDqlxceRmll4WtLGzInSNHsIgXEU7V2yvuqfcZdtzTnh57HfCEIW3f8Bd3Rh4vUpggBSYTaN_W7YjICamzEPDRiyKwLqJFKIDR64uO2kEoLkKg Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 54cebab3bf1f440dbaa4ef020177a4bb Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-TestVolumeBootPattern-1322010073 Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 18:00:03.606004 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 18:00:03.608565 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/54cebab3bf1f440dbaa4ef020177a4bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/54cebab3bf1f440dbaa4ef020177a4bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_54cebab3bf1f440dbaa4ef020177a4bb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/54cebab3bf1f440dbaa4ef020177a4bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 18:00:03.608565 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-TestVolumeBootPattern-1322010073 Aug 24 18:00:03.608565 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 54cebab3bf1f440dbaa4ef020177a4bb Aug 24 18:00:03.608565 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-TestVolumeBootPattern-1322010073 Aug 24 18:00:03.608565 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-TestVolumeBootPattern-1322010073-project Aug 24 18:00:03.608565 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 18:00:03.608565 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 18:00:03.608565 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: f19bf0e6a8ad425cbbf804d6d7be5a0a Aug 24 18:00:03.608565 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-TestVolumeBootPattern-1322010073-project Aug 24 18:00:03.608565 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 18:00:03.608565 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 could not be found. Aug 24 18:00:03.608565 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': 'aa9d4f71-3435-4fe1-94c1-3c2aa90852e0'} Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 could not be found. Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 18:00:03.610058 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 18:00:03.612380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 18:00:03.612380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 18:00:03.612380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 18:00:03.612380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 18:00:03.612380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 18:00:03.612380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 18:00:03.612380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 18:00:03.612380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 could not be found. Aug 24 18:00:03.612380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 18:00:03.612380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:00:03.612380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 18:00:03.612380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:03.612380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:00:03.612380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:00:03.612380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 18:00:03.612380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 18:00:03.612380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 could not be found. Aug 24 18:00:03.612380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 18:00:03.614970 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a43a519f-eb69-4f04-98dd-41215bc824a3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Returning 404 to user: Instance aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 18:00:03.614970 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a43a519f-eb69-4f04-98dd-41215bc824a3 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0" status: 404 len: 111 microversion: 2.1 time: 0.031938 Aug 24 18:00:03.614970 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 566/1134] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:00:03 2022] GET /compute/v2.1/servers/aa9d4f71-3435-4fe1-94c1-3c2aa90852e0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 18:00:04.125963 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e3799e87-e204-44f0-871d-85a31b53b5df tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:04.126516 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-e3799e87-e204-44f0-871d-85a31b53b5df tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:04.132878 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e3799e87-e204-44f0-871d-85a31b53b5df tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:04.133361 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e3799e87-e204-44f0-871d-85a31b53b5df tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:04.133802 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e3799e87-e204-44f0-871d-85a31b53b5df tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:04.134778 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e3799e87-e204-44f0-871d-85a31b53b5df tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:04.135234 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e3799e87-e204-44f0-871d-85a31b53b5df tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:04.135702 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-e3799e87-e204-44f0-871d-85a31b53b5df tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:04.149270 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-e3799e87-e204-44f0-871d-85a31b53b5df tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] HTTP exception thrown: Instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 could not be found. Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e3799e87-e204-44f0-871d-85a31b53b5df tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Request method failure captured: Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: DELETE /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 HTTP/1.1 Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmVA6wpgWgaeWvIIIWR-Jnwuaby9_LW__hON31Wmek0wwA_G9g0PcV8zZD3Ov7jBKLDqlxceRmll4WtLGzInSNHsIgXEU7V2yvuqfcZdtzTnh57HfCEIW3f8Bd3Rh4vUpggBSYTaN_W7YjICamzEPDRiyKwLqJFKIDR64uO2kEoLkKg Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 54cebab3bf1f440dbaa4ef020177a4bb Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-TestVolumeBootPattern-1322010073 Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 18:00:04.150939 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 18:00:04.152659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/54cebab3bf1f440dbaa4ef020177a4bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/54cebab3bf1f440dbaa4ef020177a4bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_54cebab3bf1f440dbaa4ef020177a4bb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/54cebab3bf1f440dbaa4ef020177a4bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 18:00:04.152659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-TestVolumeBootPattern-1322010073 Aug 24 18:00:04.152659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 54cebab3bf1f440dbaa4ef020177a4bb Aug 24 18:00:04.152659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-TestVolumeBootPattern-1322010073 Aug 24 18:00:04.152659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-TestVolumeBootPattern-1322010073-project Aug 24 18:00:04.152659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 18:00:04.152659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 18:00:04.152659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: f19bf0e6a8ad425cbbf804d6d7be5a0a Aug 24 18:00:04.152659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-TestVolumeBootPattern-1322010073-project Aug 24 18:00:04.152659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 18:00:04.152659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 could not be found. Aug 24 18:00:04.152659 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': '829f4d8c-fcd5-4611-9878-af9c7b30e362'} Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 could not be found. Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 18:00:04.153587 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 could not be found. Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 could not be found. Aug 24 18:00:04.155132 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 18:00:04.156803 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-e3799e87-e204-44f0-871d-85a31b53b5df tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Returning 404 to user: Instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 18:00:04.156803 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-e3799e87-e204-44f0-871d-85a31b53b5df tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "DELETE /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 404 len: 111 microversion: 2.1 time: 0.030437 Aug 24 18:00:04.156803 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 569/1135] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 18:00:04 2022] DELETE /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 18:00:04.161202 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e8fb3b38-1af2-44c1-846e-9518f2b5576a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:04.161767 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-e8fb3b38-1af2-44c1-846e-9518f2b5576a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] [instance: 829f4d8c-fcd5-4611-9878-af9c7b30e362] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:04.168481 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e8fb3b38-1af2-44c1-846e-9518f2b5576a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:04.168967 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e8fb3b38-1af2-44c1-846e-9518f2b5576a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:04.169412 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e8fb3b38-1af2-44c1-846e-9518f2b5576a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:04.170408 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e8fb3b38-1af2-44c1-846e-9518f2b5576a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:04.170870 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e8fb3b38-1af2-44c1-846e-9518f2b5576a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:04.171306 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-e8fb3b38-1af2-44c1-846e-9518f2b5576a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:04.185950 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-e8fb3b38-1af2-44c1-846e-9518f2b5576a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] HTTP exception thrown: Instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 could not be found. Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e8fb3b38-1af2-44c1-846e-9518f2b5576a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Request method failure captured: Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 HTTP/1.1 Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmVA6wpgWgaeWvIIIWR-Jnwuaby9_LW__hON31Wmek0wwA_G9g0PcV8zZD3Ov7jBKLDqlxceRmll4WtLGzInSNHsIgXEU7V2yvuqfcZdtzTnh57HfCEIW3f8Bd3Rh4vUpggBSYTaN_W7YjICamzEPDRiyKwLqJFKIDR64uO2kEoLkKg Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 54cebab3bf1f440dbaa4ef020177a4bb Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-TestVolumeBootPattern-1322010073 Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 18:00:04.187476 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 18:00:04.189036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/54cebab3bf1f440dbaa4ef020177a4bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/54cebab3bf1f440dbaa4ef020177a4bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_54cebab3bf1f440dbaa4ef020177a4bb", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/54cebab3bf1f440dbaa4ef020177a4bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 18:00:04.189036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-TestVolumeBootPattern-1322010073 Aug 24 18:00:04.189036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 54cebab3bf1f440dbaa4ef020177a4bb Aug 24 18:00:04.189036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-TestVolumeBootPattern-1322010073 Aug 24 18:00:04.189036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-TestVolumeBootPattern-1322010073-project Aug 24 18:00:04.189036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 18:00:04.189036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 18:00:04.189036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: f19bf0e6a8ad425cbbf804d6d7be5a0a Aug 24 18:00:04.189036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-TestVolumeBootPattern-1322010073-project Aug 24 18:00:04.189036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 18:00:04.189036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 could not be found. Aug 24 18:00:04.189036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': '829f4d8c-fcd5-4611-9878-af9c7b30e362'} Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 could not be found. Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 18:00:04.190009 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 18:00:04.191337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 18:00:04.191337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 18:00:04.191337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 18:00:04.191337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 18:00:04.191337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 18:00:04.191337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 18:00:04.191337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 18:00:04.191337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 could not be found. Aug 24 18:00:04.191337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 18:00:04.191337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:00:04.191337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 18:00:04.191337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:04.191337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:00:04.191337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:00:04.191337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 18:00:04.191337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 18:00:04.191337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 could not be found. Aug 24 18:00:04.191337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 18:00:04.192579 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-e8fb3b38-1af2-44c1-846e-9518f2b5576a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Returning 404 to user: Instance 829f4d8c-fcd5-4611-9878-af9c7b30e362 could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 18:00:04.192579 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-e8fb3b38-1af2-44c1-846e-9518f2b5576a tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362" status: 404 len: 111 microversion: 2.1 time: 0.031676 Aug 24 18:00:04.192579 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 567/1136] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:00:04 2022] GET /compute/v2.1/servers/829f4d8c-fcd5-4611-9878-af9c7b30e362 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 18:00:05.729909 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1c473ec8-8175-4be3-ba74-2f35fd9e9f59 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] Calling method '.version_select at 0x7fce77486e50>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:05.818232 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1c473ec8-8175-4be3-ba74-2f35fd9e9f59 tempest-TestVolumeBootPattern-1322010073 tempest-TestVolumeBootPattern-1322010073-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1931889606" status: 202 len: 0 microversion: 2.1 time: 0.092231 Aug 24 18:00:05.818816 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 570/1137] 10.222.0.76 () {58 vars in 1263 bytes} [Wed Aug 24 18:00:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1931889606 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 18:00:24.568615 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-83fe4862-41a6-4a8f-8a02-b27a32abb03b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-79739178"}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 18:00:24.569184 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-83fe4862-41a6-4a8f-8a02-b27a32abb03b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:24.571464 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:00:24.572389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:00:24.576959 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-83fe4862-41a6-4a8f-8a02-b27a32abb03b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:24.577441 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-83fe4862-41a6-4a8f-8a02-b27a32abb03b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:24.577948 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-83fe4862-41a6-4a8f-8a02-b27a32abb03b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:24.579186 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-83fe4862-41a6-4a8f-8a02-b27a32abb03b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:24.579692 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-83fe4862-41a6-4a8f-8a02-b27a32abb03b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:24.580123 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-83fe4862-41a6-4a8f-8a02-b27a32abb03b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:24.716458 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.network.security_group_api [None req-83fe4862-41a6-4a8f-8a02-b27a32abb03b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Removing security group d3359091-90ce-43fa-9115-1b1ead0f645c from port aa39e6f6-d4ec-40b7-ab96-a41e7d6771ff Aug 24 18:00:25.126484 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-83fe4862-41a6-4a8f-8a02-b27a32abb03b tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "POST /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f/action" status: 202 len: 0 microversion: 2.1 time: 0.557594 Aug 24 18:00:25.126484 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 568/1138] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 18:00:24 2022] POST /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 18:00:25.130092 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:00:25.131585 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:00:25.375213 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-eb33f4b6-e777-4f68-b442-57b0b946a22a req-0ed67453-6390-47cc-976e-a6a7409bda4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f", "tag": "aa39e6f6-d4ec-40b7-ab96-a41e7d6771ff"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 18:00:25.386572 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-eb33f4b6-e777-4f68-b442-57b0b946a22a req-0ed67453-6390-47cc-976e-a6a7409bda4a service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:25.387058 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-eb33f4b6-e777-4f68-b442-57b0b946a22a req-0ed67453-6390-47cc-976e-a6a7409bda4a service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:25.387542 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-eb33f4b6-e777-4f68-b442-57b0b946a22a req-0ed67453-6390-47cc-976e-a6a7409bda4a service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:25.399101 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-eb33f4b6-e777-4f68-b442-57b0b946a22a req-0ed67453-6390-47cc-976e-a6a7409bda4a service nova] Creating event network-changed:aa39e6f6-d4ec-40b7-ab96-a41e7d6771ff for instance 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f on hv-cinder-85442 Aug 24 18:00:25.404632 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-eb33f4b6-e777-4f68-b442-57b0b946a22a req-0ed67453-6390-47cc-976e-a6a7409bda4a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.276257 Aug 24 18:00:25.405563 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 571/1139] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 18:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 18:00:26.577456 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0c4fc143-df4b-4332-8661-6ec80d2523f4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:26.578086 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0c4fc143-df4b-4332-8661-6ec80d2523f4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:26.582774 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-67ed58d8-c9a2-4727-beaa-f77849e6e462 req-46c4366e-7bf6-41ec-9871-463211b66c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f", "tag": "aa39e6f6-d4ec-40b7-ab96-a41e7d6771ff"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 18:00:26.585014 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c4fc143-df4b-4332-8661-6ec80d2523f4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:26.589133 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c4fc143-df4b-4332-8661-6ec80d2523f4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:26.589133 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c4fc143-df4b-4332-8661-6ec80d2523f4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:26.589133 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c4fc143-df4b-4332-8661-6ec80d2523f4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:26.589133 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c4fc143-df4b-4332-8661-6ec80d2523f4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:26.589487 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0c4fc143-df4b-4332-8661-6ec80d2523f4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:26.595366 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-67ed58d8-c9a2-4727-beaa-f77849e6e462 req-46c4366e-7bf6-41ec-9871-463211b66c42 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:26.596050 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-67ed58d8-c9a2-4727-beaa-f77849e6e462 req-46c4366e-7bf6-41ec-9871-463211b66c42 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:26.596633 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-67ed58d8-c9a2-4727-beaa-f77849e6e462 req-46c4366e-7bf6-41ec-9871-463211b66c42 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:26.610234 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-67ed58d8-c9a2-4727-beaa-f77849e6e462 req-46c4366e-7bf6-41ec-9871-463211b66c42 service nova] Creating event network-changed:aa39e6f6-d4ec-40b7-ab96-a41e7d6771ff for instance 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f on hv-cinder-85442 Aug 24 18:00:26.615562 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-67ed58d8-c9a2-4727-beaa-f77849e6e462 req-46c4366e-7bf6-41ec-9871-463211b66c42 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038119 Aug 24 18:00:26.616154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 572/1140] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 18:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 18:00:26.682213 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-0c4fc143-df4b-4332-8661-6ec80d2523f4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lazy-loading 'services' on Instance uuid 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 18:00:27.022414 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0c4fc143-df4b-4332-8661-6ec80d2523f4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "DELETE /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f/os-volume_attachments/a9b11fb4-60eb-44f0-973e-9631ef09c38e" status: 202 len: 0 microversion: 2.1 time: 0.448831 Aug 24 18:00:27.023172 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 569/1141] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 18:00:26 2022] DELETE /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f/os-volume_attachments/a9b11fb4-60eb-44f0-973e-9631ef09c38e => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 18:00:27.033513 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-3d4302a3-fe76-46fd-999a-eb0e05b1f785 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:27.036071 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-3d4302a3-fe76-46fd-999a-eb0e05b1f785 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:27.044329 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3d4302a3-fe76-46fd-999a-eb0e05b1f785 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:27.044818 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3d4302a3-fe76-46fd-999a-eb0e05b1f785 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:27.045253 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3d4302a3-fe76-46fd-999a-eb0e05b1f785 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:27.045981 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3d4302a3-fe76-46fd-999a-eb0e05b1f785 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:27.046476 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3d4302a3-fe76-46fd-999a-eb0e05b1f785 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:27.053799 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-3d4302a3-fe76-46fd-999a-eb0e05b1f785 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:27.079497 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-3d4302a3-fe76-46fd-999a-eb0e05b1f785 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051019 Aug 24 18:00:27.082030 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 573/1142] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 18:00:27 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 18:00:28.093098 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-f3fd9850-18df-486a-bb1d-154a9a803156 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:28.095702 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-f3fd9850-18df-486a-bb1d-154a9a803156 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:28.102238 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f3fd9850-18df-486a-bb1d-154a9a803156 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:28.102672 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f3fd9850-18df-486a-bb1d-154a9a803156 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:28.103115 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f3fd9850-18df-486a-bb1d-154a9a803156 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:28.103811 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f3fd9850-18df-486a-bb1d-154a9a803156 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:28.104268 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f3fd9850-18df-486a-bb1d-154a9a803156 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:28.104774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-f3fd9850-18df-486a-bb1d-154a9a803156 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:28.134607 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-f3fd9850-18df-486a-bb1d-154a9a803156 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046392 Aug 24 18:00:28.135162 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 570/1143] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 18:00:28 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 18:00:28.146683 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-8d7779cf-610d-470d-b278-f64ec38da710 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:28.147256 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-8d7779cf-610d-470d-b278-f64ec38da710 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:28.153618 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8d7779cf-610d-470d-b278-f64ec38da710 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:28.154141 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8d7779cf-610d-470d-b278-f64ec38da710 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:28.154588 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8d7779cf-610d-470d-b278-f64ec38da710 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:28.155275 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8d7779cf-610d-470d-b278-f64ec38da710 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:28.155733 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8d7779cf-610d-470d-b278-f64ec38da710 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:28.156158 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8d7779cf-610d-470d-b278-f64ec38da710 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:28.231376 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-8d7779cf-610d-470d-b278-f64ec38da710 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] HTTP exception thrown: Instance 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f is not attached to volume a9b11fb4-60eb-44f0-973e-9631ef09c38e Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-8d7779cf-610d-470d-b278-f64ec38da710 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Request method failure captured: Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: DELETE /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f/os-volume_attachments/a9b11fb4-60eb-44f0-973e-9631ef09c38e HTTP/1.1 Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmbB7jvzUoAfFteG_H51goq9YQJI59LPaGOv4iW97Sl8HXCFc_QqVhuryXpt4gee6Cf6KMx1tWaGcRXfoCbDDyXqLNVtwmTUb3bYR3oY_kXcK8MpTHLxmzklS3JznlNX68iaHTGzIZiPPvhwFCxUFoD9rntsuqdpgotlTMRzGZohwa4 Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 193c5ec786e74f138b2fc58ab35367ff Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-TestMinimumBasicScenario-345747046 Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 18:00:28.233743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 18:00:28.235402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/193c5ec786e74f138b2fc58ab35367ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/193c5ec786e74f138b2fc58ab35367ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_193c5ec786e74f138b2fc58ab35367ff", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/193c5ec786e74f138b2fc58ab35367ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 18:00:28.235402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-TestMinimumBasicScenario-345747046 Aug 24 18:00:28.235402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 193c5ec786e74f138b2fc58ab35367ff Aug 24 18:00:28.235402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-TestMinimumBasicScenario-345747046 Aug 24 18:00:28.235402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-TestMinimumBasicScenario-345747046-project Aug 24 18:00:28.235402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 18:00:28.235402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 18:00:28.235402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: 196ffd853b234fce845f359484d4b5e2 Aug 24 18:00:28.235402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-TestMinimumBasicScenario-345747046-project Aug 24 18:00:28.235402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 18:00:28.235402 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f is not attached to volume a9b11fb4-60eb-44f0-973e-9631ef09c38e Aug 24 18:00:28.236492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'server_id': '02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f', 'id': 'a9b11fb4-60eb-44f0-973e-9631ef09c38e'} Aug 24 18:00:28.236492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 18:00:28.236492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:28.236492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 18:00:28.236492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 18:00:28.236492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 18:00:28.236492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 18:00:28.236492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 18:00:28.236492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 18:00:28.236492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a9b11fb4-60eb-44f0-973e-9631ef09c38e. Aug 24 18:00:28.236492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 18:00:28.236492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:00:28.236492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 18:00:28.236492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:28.236492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:00:28.236492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:00:28.236492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 18:00:28.236492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 18:00:28.236492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 18:00:28.238003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 18:00:28.238003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 18:00:28.238003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 18:00:28.238003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f is not attached to volume a9b11fb4-60eb-44f0-973e-9631ef09c38e Aug 24 18:00:28.238003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 18:00:28.238003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:00:28.238003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 18:00:28.238003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:28.238003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:00:28.238003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:00:28.238003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 18:00:28.238003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 18:00:28.238003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f is not attached to volume a9b11fb4-60eb-44f0-973e-9631ef09c38e Aug 24 18:00:28.238003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 18:00:28.238003 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-8d7779cf-610d-470d-b278-f64ec38da710 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Returning 404 to user: Instance 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f is not attached to volume a9b11fb4-60eb-44f0-973e-9631ef09c38e {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 18:00:28.239318 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-8d7779cf-610d-470d-b278-f64ec38da710 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "DELETE /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f/os-volume_attachments/a9b11fb4-60eb-44f0-973e-9631ef09c38e" status: 404 len: 154 microversion: 2.1 time: 0.093179 Aug 24 18:00:28.239318 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 574/1144] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 18:00:28 2022] DELETE /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f/os-volume_attachments/a9b11fb4-60eb-44f0-973e-9631ef09c38e => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 18:00:29.475815 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-48b56601-188d-4735-b7ad-72b7c6471db5 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:29.476310 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-48b56601-188d-4735-b7ad-72b7c6471db5 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:29.482702 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-48b56601-188d-4735-b7ad-72b7c6471db5 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:29.483191 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-48b56601-188d-4735-b7ad-72b7c6471db5 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:29.483637 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-48b56601-188d-4735-b7ad-72b7c6471db5 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:29.484327 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-48b56601-188d-4735-b7ad-72b7c6471db5 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:29.484786 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-48b56601-188d-4735-b7ad-72b7c6471db5 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:29.485214 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-48b56601-188d-4735-b7ad-72b7c6471db5 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:29.510003 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-48b56601-188d-4735-b7ad-72b7c6471db5 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Going to try to terminate instance {{(pid=127676) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 18:00:29.832977 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-48b56601-188d-4735-b7ad-72b7c6471db5 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "DELETE /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 204 len: 0 microversion: 2.1 time: 0.360756 Aug 24 18:00:29.833563 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 571/1145] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 18:00:29 2022] DELETE /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 18:00:29.841710 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-82e05d45-4a2d-477e-a6f9-731db159aae4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:29.842396 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-82e05d45-4a2d-477e-a6f9-731db159aae4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:29.849279 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-82e05d45-4a2d-477e-a6f9-731db159aae4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:29.849760 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-82e05d45-4a2d-477e-a6f9-731db159aae4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:29.850228 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-82e05d45-4a2d-477e-a6f9-731db159aae4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:29.850918 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-82e05d45-4a2d-477e-a6f9-731db159aae4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:29.851375 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-82e05d45-4a2d-477e-a6f9-731db159aae4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:29.851803 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-82e05d45-4a2d-477e-a6f9-731db159aae4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:29.990492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-82e05d45-4a2d-477e-a6f9-731db159aae4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:00:29.998270 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-82e05d45-4a2d-477e-a6f9-731db159aae4 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1554 microversion: 2.1 time: 0.160354 Aug 24 18:00:29.998829 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 575/1146] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:00:29 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:00:31.022030 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-49822c1b-b9d7-44c3-9df4-70097c59b9ba tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:31.022733 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-49822c1b-b9d7-44c3-9df4-70097c59b9ba tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:31.029084 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49822c1b-b9d7-44c3-9df4-70097c59b9ba tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:31.029564 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49822c1b-b9d7-44c3-9df4-70097c59b9ba tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:31.030041 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49822c1b-b9d7-44c3-9df4-70097c59b9ba tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:31.035346 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49822c1b-b9d7-44c3-9df4-70097c59b9ba tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:31.035346 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49822c1b-b9d7-44c3-9df4-70097c59b9ba tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:31.035346 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-49822c1b-b9d7-44c3-9df4-70097c59b9ba tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:31.179062 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-49822c1b-b9d7-44c3-9df4-70097c59b9ba tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:00:31.186971 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-49822c1b-b9d7-44c3-9df4-70097c59b9ba tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1554 microversion: 2.1 time: 0.169843 Aug 24 18:00:31.194260 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 572/1147] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:00:31 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:00:32.046224 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-57467787-5fe2-4a9a-bf0a-66e421feb5d6 req-0bddcba2-a4a4-4f2a-b90c-089e26ae04fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f", "name": "network-vif-deleted", "tag": "aa39e6f6-d4ec-40b7-ab96-a41e7d6771ff"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 18:00:32.056800 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-57467787-5fe2-4a9a-bf0a-66e421feb5d6 req-0bddcba2-a4a4-4f2a-b90c-089e26ae04fb service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:32.057446 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-57467787-5fe2-4a9a-bf0a-66e421feb5d6 req-0bddcba2-a4a4-4f2a-b90c-089e26ae04fb service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:32.057909 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-57467787-5fe2-4a9a-bf0a-66e421feb5d6 req-0bddcba2-a4a4-4f2a-b90c-089e26ae04fb service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:32.069323 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-57467787-5fe2-4a9a-bf0a-66e421feb5d6 req-0bddcba2-a4a4-4f2a-b90c-089e26ae04fb service nova] Creating event network-vif-deleted:aa39e6f6-d4ec-40b7-ab96-a41e7d6771ff for instance 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f on hv-cinder-85442 Aug 24 18:00:32.074237 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-57467787-5fe2-4a9a-bf0a-66e421feb5d6 req-0bddcba2-a4a4-4f2a-b90c-089e26ae04fb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031642 Aug 24 18:00:32.074810 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 576/1148] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 18:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 18:00:32.211817 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-cd3e9cc9-a278-4b97-acc6-de9f73205966 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:32.212423 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-cd3e9cc9-a278-4b97-acc6-de9f73205966 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:32.218786 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cd3e9cc9-a278-4b97-acc6-de9f73205966 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:32.225177 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cd3e9cc9-a278-4b97-acc6-de9f73205966 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:32.225177 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cd3e9cc9-a278-4b97-acc6-de9f73205966 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:32.225177 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cd3e9cc9-a278-4b97-acc6-de9f73205966 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:32.225177 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cd3e9cc9-a278-4b97-acc6-de9f73205966 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:32.225605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cd3e9cc9-a278-4b97-acc6-de9f73205966 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:32.288447 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-cd3e9cc9-a278-4b97-acc6-de9f73205966 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196ffd853b234fce845f359484d4b5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193c5ec786e74f138b2fc58ab35367ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:00:32.296394 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-cd3e9cc9-a278-4b97-acc6-de9f73205966 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 200 len: 1343 microversion: 2.1 time: 0.088459 Aug 24 18:00:32.296958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 573/1149] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:00:32 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 1343 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:00:33.318705 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-554cb21d-19c7-4cf8-bd87-014807d60256 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:33.319408 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-554cb21d-19c7-4cf8-bd87-014807d60256 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] [instance: 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:33.325566 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-554cb21d-19c7-4cf8-bd87-014807d60256 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:33.326093 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-554cb21d-19c7-4cf8-bd87-014807d60256 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:33.326537 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-554cb21d-19c7-4cf8-bd87-014807d60256 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:33.327229 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-554cb21d-19c7-4cf8-bd87-014807d60256 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:33.327689 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-554cb21d-19c7-4cf8-bd87-014807d60256 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:33.328120 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-554cb21d-19c7-4cf8-bd87-014807d60256 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:33.342051 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.wsgi [None req-554cb21d-19c7-4cf8-bd87-014807d60256 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] HTTP exception thrown: Instance 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f could not be found. Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-554cb21d-19c7-4cf8-bd87-014807d60256 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Request method failure captured: Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: request: GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f HTTP/1.1 Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept: application/json Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Accept-Encoding: identity Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Connection: close Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Length: 0 Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Content-Type: application/json Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Host: 10.222.0.76 Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Openstack-System-Scope: None Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: User-Agent: python-urllib3/1.26.11 Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Auth-Token: gAAAAABjBmbB7jvzUoAfFteG_H51goq9YQJI59LPaGOv4iW97Sl8HXCFc_QqVhuryXpt4gee6Cf6KMx1tWaGcRXfoCbDDyXqLNVtwmTUb3bYR3oY_kXcK8MpTHLxmzklS3JznlNX68iaHTGzIZiPPvhwFCxUFoD9rntsuqdpgotlTMRzGZohwa4 Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Id: None Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Domain-Name: None Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Identity-Status: Confirmed Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Is-Admin-Project: True Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Id: default Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Domain-Name: Default Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Id: 193c5ec786e74f138b2fc58ab35367ff Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Project-Name: tempest-TestMinimumBasicScenario-345747046 Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Role: member,reader Aug 24 18:00:33.343696 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Roles: member,reader Aug 24 18:00:33.345352 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/193c5ec786e74f138b2fc58ab35367ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/193c5ec786e74f138b2fc58ab35367ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_193c5ec786e74f138b2fc58ab35367ff", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/193c5ec786e74f138b2fc58ab35367ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 18:00:33.345352 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant: tempest-TestMinimumBasicScenario-345747046 Aug 24 18:00:33.345352 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Id: 193c5ec786e74f138b2fc58ab35367ff Aug 24 18:00:33.345352 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-Tenant-Name: tempest-TestMinimumBasicScenario-345747046 Aug 24 18:00:33.345352 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User: tempest-TestMinimumBasicScenario-345747046-project Aug 24 18:00:33.345352 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Id: default Aug 24 18:00:33.345352 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Domain-Name: Default Aug 24 18:00:33.345352 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Id: 196ffd853b234fce845f359484d4b5e2 Aug 24 18:00:33.345352 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: X-User-Name: tempest-TestMinimumBasicScenario-345747046-project Aug 24 18:00:33.345352 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: method: > Aug 24 18:00:33.345352 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: exception: Instance 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f could not be found. Aug 24 18:00:33.345352 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: action_args: {'id': '02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f'} Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f could not be found. Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 18:00:33.346331 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 18:00:33.348293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 18:00:33.348293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 18:00:33.348293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 18:00:33.348293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 18:00:33.348293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 18:00:33.348293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 18:00:33.348293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 18:00:33.348293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f could not be found. Aug 24 18:00:33.348293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 18:00:33.348293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:00:33.348293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 18:00:33.348293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:33.348293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:00:33.348293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:00:33.348293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 18:00:33.348293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 18:00:33.348293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f could not be found. Aug 24 18:00:33.348293 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR nova.api.openstack.wsgi Aug 24 18:00:33.349689 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-554cb21d-19c7-4cf8-bd87-014807d60256 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Returning 404 to user: Instance 02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f could not be found. {{(pid=127677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 18:00:33.349689 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-554cb21d-19c7-4cf8-bd87-014807d60256 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f" status: 404 len: 111 microversion: 2.1 time: 0.031599 Aug 24 18:00:33.349689 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 577/1150] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:00:33 2022] GET /compute/v2.1/servers/02f0c1dc-a8fc-4588-ab5e-e8e3bb48bc0f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 18:00:33.353885 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0d38d025-6970-425c-a1b5-8db58178efa1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] Calling method '.version_select at 0x7fce773b99d0>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:33.428840 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0d38d025-6970-425c-a1b5-8db58178efa1 tempest-TestMinimumBasicScenario-345747046 tempest-TestMinimumBasicScenario-345747046-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1325532022" status: 202 len: 0 microversion: 2.1 time: 0.078651 Aug 24 18:00:33.429416 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 574/1151] 10.222.0.76 () {58 vars in 1272 bytes} [Wed Aug 24 18:00:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1325532022 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 18:00:56.795135 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=14 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:00:56.796110 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=26 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:00:56.982771 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9f627359-fa8b-488d-a5de-7999c21350b0 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Action: 'create', calling method: .version_select at 0x7fce774e9820>, body: {"keypair": {"name": "tempest-TestShelveInstance-265985228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRCyeEh1wx0c79td6AIsQHL4cD1rxLjOjzZymp6L7OfEhVCLAzOn4tPZjSmtLEhGBoKvkGQOwuvS0LT/kMYSxK8UJYciOHLfm9UwRsJ10ZYGM4hCwZdyJw/8iuw5SeXnA=="}} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 18:00:56.999528 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-9f627359-fa8b-488d-a5de-7999c21350b0 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Getting quotas for project 17a2ab43b0e64e888af68fc09725ef8d. Resources: {'key_pairs'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 18:00:57.003722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.quota [None req-9f627359-fa8b-488d-a5de-7999c21350b0 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Getting quotas for user f61b40f60c594f3299484e03ab34d19b and project 17a2ab43b0e64e888af68fc09725ef8d. Resources: {'key_pairs'} {{(pid=127677) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 18:00:57.108218 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9f627359-fa8b-488d-a5de-7999c21350b0 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.318982 Aug 24 18:00:57.108816 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 578/1152] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 18:00:56 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 18:01:12.104899 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:01:12.105499 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Wed Aug 24 18:01:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:01:15.787384 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-68f9b83a-6978-4dad-aecc-b89e5b51f295 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-456329203", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-265985228", "security_groups": [{"name": "tempest-secgroup-smoke-1188992893"}], "networks": [{"uuid": "80b49aae-531f-47bb-97e3-845328d659ca"}], "block_device_mapping_v2": [{"uuid": "f5d1fb8c-2c91-458e-ae96-472298a5cfbd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 18:01:15.797746 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:15.798430 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:15.904754 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.network.neutron [None req-68f9b83a-6978-4dad-aecc-b89e5b51f295 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] validate_networks() for [('80b49aae-531f-47bb-97e3-845328d659ca', None, None, None, None, None)] {{(pid=127676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 18:01:16.376416 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-68f9b83a-6978-4dad-aecc-b89e5b51f295 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Flavor limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 18:01:16.376863 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-68f9b83a-6978-4dad-aecc-b89e5b51f295 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Image limits 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 18:01:16.377346 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-68f9b83a-6978-4dad-aecc-b89e5b51f295 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Flavor pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 18:01:16.377759 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-68f9b83a-6978-4dad-aecc-b89e5b51f295 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Image pref 0:0:0 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 18:01:16.378211 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.virt.hardware [None req-68f9b83a-6978-4dad-aecc-b89e5b51f295 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 18:01:16.387477 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-68f9b83a-6978-4dad-aecc-b89e5b51f295 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:16.391166 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-68f9b83a-6978-4dad-aecc-b89e5b51f295 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:16.391166 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-68f9b83a-6978-4dad-aecc-b89e5b51f295 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:16.391166 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-68f9b83a-6978-4dad-aecc-b89e5b51f295 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:16.391166 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-68f9b83a-6978-4dad-aecc-b89e5b51f295 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:16.391563 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-68f9b83a-6978-4dad-aecc-b89e5b51f295 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:16.407287 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-68f9b83a-6978-4dad-aecc-b89e5b51f295 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Getting quotas for project 17a2ab43b0e64e888af68fc09725ef8d. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 18:01:16.411350 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.quota [None req-68f9b83a-6978-4dad-aecc-b89e5b51f295 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Getting quotas for user f61b40f60c594f3299484e03ab34d19b and project 17a2ab43b0e64e888af68fc09725ef8d. Resources: {'instances', 'ram', 'cores'} {{(pid=127676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 18:01:16.469428 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-68f9b83a-6978-4dad-aecc-b89e5b51f295 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Going to run 1 instances... {{(pid=127676) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 18:01:16.471578 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-68f9b83a-6978-4dad-aecc-b89e5b51f295 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f5d1fb8c-2c91-458e-ae96-472298a5cfbd',volume_size=None,volume_type=None)] {{(pid=127676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 18:01:16.915359 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-68f9b83a-6978-4dad-aecc-b89e5b51f295 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.132519 Aug 24 18:01:16.916329 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 575/1153] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 18:01:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 18:01:16.927159 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-57592e98-bad9-49e6-b93c-76a0c9f013dc tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:01:16.930032 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-57592e98-bad9-49e6-b93c-76a0c9f013dc tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:01:16.931847 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=4 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:16.932633 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:16.993268 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-57592e98-bad9-49e6-b93c-76a0c9f013dc tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:01:16.996845 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-57592e98-bad9-49e6-b93c-76a0c9f013dc tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1087 microversion: 2.1 time: 0.073712 Aug 24 18:01:16.997419 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 579/1154] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:01:16 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1087 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:18.019713 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-b13c8736-eef2-4a49-acbd-64a6b0afd505 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:01:18.020259 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-b13c8736-eef2-4a49-acbd-64a6b0afd505 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:01:18.027920 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b13c8736-eef2-4a49-acbd-64a6b0afd505 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:18.028411 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b13c8736-eef2-4a49-acbd-64a6b0afd505 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:18.028855 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b13c8736-eef2-4a49-acbd-64a6b0afd505 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:18.029689 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b13c8736-eef2-4a49-acbd-64a6b0afd505 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:18.030198 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b13c8736-eef2-4a49-acbd-64a6b0afd505 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:18.030638 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-b13c8736-eef2-4a49-acbd-64a6b0afd505 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:18.096430 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-b13c8736-eef2-4a49-acbd-64a6b0afd505 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:01:18.104887 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-b13c8736-eef2-4a49-acbd-64a6b0afd505 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1137 microversion: 2.1 time: 0.089730 Aug 24 18:01:18.105500 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 576/1155] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:01:18 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:19.126355 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-667f89ab-d8f5-4546-a8a1-daa81cc437ec tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:01:19.126969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-667f89ab-d8f5-4546-a8a1-daa81cc437ec tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:01:19.134996 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-667f89ab-d8f5-4546-a8a1-daa81cc437ec tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:19.135482 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-667f89ab-d8f5-4546-a8a1-daa81cc437ec tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:19.135916 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-667f89ab-d8f5-4546-a8a1-daa81cc437ec tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:19.136615 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-667f89ab-d8f5-4546-a8a1-daa81cc437ec tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:19.137066 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-667f89ab-d8f5-4546-a8a1-daa81cc437ec tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:19.137484 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-667f89ab-d8f5-4546-a8a1-daa81cc437ec tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:19.209762 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-667f89ab-d8f5-4546-a8a1-daa81cc437ec tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:01:19.219298 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-667f89ab-d8f5-4546-a8a1-daa81cc437ec tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1193 microversion: 2.1 time: 0.097383 Aug 24 18:01:19.219881 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 580/1156] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:01:19 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:20.240808 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5f03da80-2fce-4067-ad91-6959247844ad tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:01:20.242021 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5f03da80-2fce-4067-ad91-6959247844ad tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:01:20.248866 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5f03da80-2fce-4067-ad91-6959247844ad tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:20.249357 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5f03da80-2fce-4067-ad91-6959247844ad tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:20.254979 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5f03da80-2fce-4067-ad91-6959247844ad tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:20.254979 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5f03da80-2fce-4067-ad91-6959247844ad tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:20.254979 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5f03da80-2fce-4067-ad91-6959247844ad tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:20.254979 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5f03da80-2fce-4067-ad91-6959247844ad tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:20.752863 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5f03da80-2fce-4067-ad91-6959247844ad tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:01:20.760896 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5f03da80-2fce-4067-ad91-6959247844ad tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1271 microversion: 2.1 time: 0.523819 Aug 24 18:01:20.761479 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 577/1157] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:01:20 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1271 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:21.156778 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-263e9c0e-aee7-43e8-9fa8-f6ebeafe48d9 req-152f632f-61c9-4ad1-a7c0-8bc196753a59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c9a68f-596d-421a-9bed-61eb25b228ba", "tag": "039281e4-0f6b-49b6-9977-c41fac97b0ae"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 18:01:21.166836 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-263e9c0e-aee7-43e8-9fa8-f6ebeafe48d9 req-152f632f-61c9-4ad1-a7c0-8bc196753a59 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:21.167242 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-263e9c0e-aee7-43e8-9fa8-f6ebeafe48d9 req-152f632f-61c9-4ad1-a7c0-8bc196753a59 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:21.167672 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-263e9c0e-aee7-43e8-9fa8-f6ebeafe48d9 req-152f632f-61c9-4ad1-a7c0-8bc196753a59 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:21.179138 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-263e9c0e-aee7-43e8-9fa8-f6ebeafe48d9 req-152f632f-61c9-4ad1-a7c0-8bc196753a59 service nova] Creating event network-changed:039281e4-0f6b-49b6-9977-c41fac97b0ae for instance 24c9a68f-596d-421a-9bed-61eb25b228ba on hv-cinder-85442 Aug 24 18:01:21.184283 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-263e9c0e-aee7-43e8-9fa8-f6ebeafe48d9 req-152f632f-61c9-4ad1-a7c0-8bc196753a59 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031263 Aug 24 18:01:21.187594 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 581/1158] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 18:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 18:01:21.782992 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-c169d1dd-58c8-4c52-88b0-4f1adbee16e9 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:01:21.783606 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-c169d1dd-58c8-4c52-88b0-4f1adbee16e9 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:01:21.790364 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c169d1dd-58c8-4c52-88b0-4f1adbee16e9 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:21.790854 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c169d1dd-58c8-4c52-88b0-4f1adbee16e9 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:21.791288 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c169d1dd-58c8-4c52-88b0-4f1adbee16e9 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:21.791986 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c169d1dd-58c8-4c52-88b0-4f1adbee16e9 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:21.792460 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c169d1dd-58c8-4c52-88b0-4f1adbee16e9 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:21.793087 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-c169d1dd-58c8-4c52-88b0-4f1adbee16e9 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:21.967429 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-c169d1dd-58c8-4c52-88b0-4f1adbee16e9 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:01:21.975359 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-c169d1dd-58c8-4c52-88b0-4f1adbee16e9 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1259 microversion: 2.1 time: 0.196207 Aug 24 18:01:21.976143 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 578/1159] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:01:21 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1259 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:22.998561 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-166c7175-61e8-4047-834b-03fb4c742caf tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:01:22.999269 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-166c7175-61e8-4047-834b-03fb4c742caf tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:01:23.005419 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-166c7175-61e8-4047-834b-03fb4c742caf tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:23.005931 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-166c7175-61e8-4047-834b-03fb4c742caf tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:23.006627 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-166c7175-61e8-4047-834b-03fb4c742caf tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:23.007324 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-166c7175-61e8-4047-834b-03fb4c742caf tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:23.008526 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-166c7175-61e8-4047-834b-03fb4c742caf tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:23.009060 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-166c7175-61e8-4047-834b-03fb4c742caf tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:23.149145 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-166c7175-61e8-4047-834b-03fb4c742caf tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:01:23.156959 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-166c7175-61e8-4047-834b-03fb4c742caf tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1259 microversion: 2.1 time: 0.163616 Aug 24 18:01:23.157527 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 582/1160] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:01:22 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:24.176816 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a47e0478-5aa1-4e32-99ba-9514338d3229 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:01:24.177367 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a47e0478-5aa1-4e32-99ba-9514338d3229 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:01:24.184156 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a47e0478-5aa1-4e32-99ba-9514338d3229 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:24.184642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a47e0478-5aa1-4e32-99ba-9514338d3229 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:24.185082 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a47e0478-5aa1-4e32-99ba-9514338d3229 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:24.185774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a47e0478-5aa1-4e32-99ba-9514338d3229 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:24.186259 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a47e0478-5aa1-4e32-99ba-9514338d3229 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:24.186693 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a47e0478-5aa1-4e32-99ba-9514338d3229 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:24.320042 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a47e0478-5aa1-4e32-99ba-9514338d3229 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:01:24.328391 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a47e0478-5aa1-4e32-99ba-9514338d3229 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1259 microversion: 2.1 time: 0.155551 Aug 24 18:01:24.328949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 579/1161] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:01:24 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:25.350890 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-edf7abd5-0add-42e8-bc4e-893c47020724 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:01:25.352288 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-edf7abd5-0add-42e8-bc4e-893c47020724 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:01:25.358820 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-edf7abd5-0add-42e8-bc4e-893c47020724 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:25.359304 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-edf7abd5-0add-42e8-bc4e-893c47020724 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:25.359743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-edf7abd5-0add-42e8-bc4e-893c47020724 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:25.360436 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-edf7abd5-0add-42e8-bc4e-893c47020724 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:25.360889 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-edf7abd5-0add-42e8-bc4e-893c47020724 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:25.361317 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-edf7abd5-0add-42e8-bc4e-893c47020724 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:25.492477 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-edf7abd5-0add-42e8-bc4e-893c47020724 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:01:25.500199 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-edf7abd5-0add-42e8-bc4e-893c47020724 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1259 microversion: 2.1 time: 0.153252 Aug 24 18:01:25.500761 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 583/1162] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:01:25 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:26.520616 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-2aa0f437-986b-4558-9a30-477e3b064990 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:01:26.521230 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-2aa0f437-986b-4558-9a30-477e3b064990 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:01:26.523576 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=2 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:26.524245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell0:SELECT=6 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:26.529552 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2aa0f437-986b-4558-9a30-477e3b064990 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:26.530078 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2aa0f437-986b-4558-9a30-477e3b064990 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:26.530520 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2aa0f437-986b-4558-9a30-477e3b064990 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:26.531211 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2aa0f437-986b-4558-9a30-477e3b064990 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:26.531672 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2aa0f437-986b-4558-9a30-477e3b064990 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:26.532097 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2aa0f437-986b-4558-9a30-477e3b064990 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:26.668384 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-2aa0f437-986b-4558-9a30-477e3b064990 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:01:26.676508 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-2aa0f437-986b-4558-9a30-477e3b064990 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1259 microversion: 2.1 time: 0.159765 Aug 24 18:01:26.677073 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 580/1163] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:01:26 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:27.698771 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4f854faf-6dfc-4ce3-aefb-d28fce540c2c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:01:27.699514 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4f854faf-6dfc-4ce3-aefb-d28fce540c2c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:01:27.706134 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4f854faf-6dfc-4ce3-aefb-d28fce540c2c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:27.706610 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4f854faf-6dfc-4ce3-aefb-d28fce540c2c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:27.707040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4f854faf-6dfc-4ce3-aefb-d28fce540c2c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:27.707723 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4f854faf-6dfc-4ce3-aefb-d28fce540c2c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:27.708171 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4f854faf-6dfc-4ce3-aefb-d28fce540c2c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:27.708599 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4f854faf-6dfc-4ce3-aefb-d28fce540c2c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:27.843711 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-4f854faf-6dfc-4ce3-aefb-d28fce540c2c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:01:27.851492 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-4f854faf-6dfc-4ce3-aefb-d28fce540c2c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1259 microversion: 2.1 time: 0.157410 Aug 24 18:01:27.853178 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 584/1164] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:01:27 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:28.873626 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a342d2d4-4357-4327-83e1-d24d9000b234 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:01:28.874275 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a342d2d4-4357-4327-83e1-d24d9000b234 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:01:28.880786 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a342d2d4-4357-4327-83e1-d24d9000b234 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:28.881528 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a342d2d4-4357-4327-83e1-d24d9000b234 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:28.882002 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a342d2d4-4357-4327-83e1-d24d9000b234 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:28.882701 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a342d2d4-4357-4327-83e1-d24d9000b234 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:28.883162 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a342d2d4-4357-4327-83e1-d24d9000b234 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:28.883592 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a342d2d4-4357-4327-83e1-d24d9000b234 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:29.019599 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-a342d2d4-4357-4327-83e1-d24d9000b234 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:01:29.027404 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a342d2d4-4357-4327-83e1-d24d9000b234 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1259 microversion: 2.1 time: 0.157685 Aug 24 18:01:29.027968 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 581/1165] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:01:28 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:30.047954 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-5b9de842-6b41-4d58-b279-5f2793b3b60f tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:01:30.048562 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-5b9de842-6b41-4d58-b279-5f2793b3b60f tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:01:30.051001 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell0:SELECT=2 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:30.056484 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5b9de842-6b41-4d58-b279-5f2793b3b60f tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:30.056969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5b9de842-6b41-4d58-b279-5f2793b3b60f tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:30.057401 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5b9de842-6b41-4d58-b279-5f2793b3b60f tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:30.058128 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5b9de842-6b41-4d58-b279-5f2793b3b60f tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:30.058581 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5b9de842-6b41-4d58-b279-5f2793b3b60f tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:30.059038 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5b9de842-6b41-4d58-b279-5f2793b3b60f tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:30.192989 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5b9de842-6b41-4d58-b279-5f2793b3b60f tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:01:30.201019 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-5b9de842-6b41-4d58-b279-5f2793b3b60f tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1259 microversion: 2.1 time: 0.156875 Aug 24 18:01:30.201579 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 585/1166] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:01:30 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:31.222014 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-584db90f-39b5-4f4c-946b-72072b1e1194 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:01:31.222656 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-584db90f-39b5-4f4c-946b-72072b1e1194 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:01:31.229301 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-584db90f-39b5-4f4c-946b-72072b1e1194 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:31.229786 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-584db90f-39b5-4f4c-946b-72072b1e1194 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:31.230258 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-584db90f-39b5-4f4c-946b-72072b1e1194 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:31.230949 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-584db90f-39b5-4f4c-946b-72072b1e1194 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:31.231404 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-584db90f-39b5-4f4c-946b-72072b1e1194 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:31.231832 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-584db90f-39b5-4f4c-946b-72072b1e1194 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:31.375064 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-584db90f-39b5-4f4c-946b-72072b1e1194 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:01:31.383498 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-584db90f-39b5-4f4c-946b-72072b1e1194 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1259 microversion: 2.1 time: 0.165365 Aug 24 18:01:31.384764 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 582/1167] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:01:31 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:31.505559 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-e4480a19-d214-410b-8376-a44798f2e800 req-4295dbf9-1faf-4a38-a487-6ee31835e9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c9a68f-596d-421a-9bed-61eb25b228ba", "name": "network-vif-plugged", "status": "completed", "tag": "039281e4-0f6b-49b6-9977-c41fac97b0ae"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 18:01:31.515212 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-e4480a19-d214-410b-8376-a44798f2e800 req-4295dbf9-1faf-4a38-a487-6ee31835e9a7 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:31.515680 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-e4480a19-d214-410b-8376-a44798f2e800 req-4295dbf9-1faf-4a38-a487-6ee31835e9a7 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:31.516130 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-e4480a19-d214-410b-8376-a44798f2e800 req-4295dbf9-1faf-4a38-a487-6ee31835e9a7 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:31.527240 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-e4480a19-d214-410b-8376-a44798f2e800 req-4295dbf9-1faf-4a38-a487-6ee31835e9a7 service nova] Creating event network-vif-plugged:039281e4-0f6b-49b6-9977-c41fac97b0ae for instance 24c9a68f-596d-421a-9bed-61eb25b228ba on hv-cinder-85442 Aug 24 18:01:31.532413 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-e4480a19-d214-410b-8376-a44798f2e800 req-4295dbf9-1faf-4a38-a487-6ee31835e9a7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088481 Aug 24 18:01:31.533023 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 586/1168] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 18:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 18:01:32.405296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-929f5e24-5a03-493a-9635-abf1a75eb1a3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:01:32.405915 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-929f5e24-5a03-493a-9635-abf1a75eb1a3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:01:32.412298 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-929f5e24-5a03-493a-9635-abf1a75eb1a3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:32.414538 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-929f5e24-5a03-493a-9635-abf1a75eb1a3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:32.414538 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-929f5e24-5a03-493a-9635-abf1a75eb1a3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:32.414538 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-929f5e24-5a03-493a-9635-abf1a75eb1a3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:32.414538 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-929f5e24-5a03-493a-9635-abf1a75eb1a3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:32.414962 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-929f5e24-5a03-493a-9635-abf1a75eb1a3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:32.547560 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-929f5e24-5a03-493a-9635-abf1a75eb1a3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:01:32.555355 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-929f5e24-5a03-493a-9635-abf1a75eb1a3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1259 microversion: 2.1 time: 0.153982 Aug 24 18:01:32.556427 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 583/1169] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:01:32 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:33.577774 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-307b2c7f-8877-4ed9-bc32-abb3819588e0 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:01:33.578505 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-307b2c7f-8877-4ed9-bc32-abb3819588e0 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:01:33.585215 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-307b2c7f-8877-4ed9-bc32-abb3819588e0 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:33.585695 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-307b2c7f-8877-4ed9-bc32-abb3819588e0 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:33.586154 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-307b2c7f-8877-4ed9-bc32-abb3819588e0 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:33.586968 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-307b2c7f-8877-4ed9-bc32-abb3819588e0 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:33.587501 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-307b2c7f-8877-4ed9-bc32-abb3819588e0 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:33.587937 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-307b2c7f-8877-4ed9-bc32-abb3819588e0 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:33.723928 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-307b2c7f-8877-4ed9-bc32-abb3819588e0 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:01:33.732509 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-307b2c7f-8877-4ed9-bc32-abb3819588e0 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1442 microversion: 2.1 time: 0.158946 Aug 24 18:01:33.733078 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 587/1170] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:01:33 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1442 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 18:01:33.753129 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ae797d6b-04f6-4ac3-bc41-89acfeae73d6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:01:33.753751 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-ae797d6b-04f6-4ac3-bc41-89acfeae73d6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:01:33.761259 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ae797d6b-04f6-4ac3-bc41-89acfeae73d6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:33.761751 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ae797d6b-04f6-4ac3-bc41-89acfeae73d6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:33.762247 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ae797d6b-04f6-4ac3-bc41-89acfeae73d6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:33.762958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ae797d6b-04f6-4ac3-bc41-89acfeae73d6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:33.763418 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ae797d6b-04f6-4ac3-bc41-89acfeae73d6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:33.763851 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ae797d6b-04f6-4ac3-bc41-89acfeae73d6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:33.896440 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-ae797d6b-04f6-4ac3-bc41-89acfeae73d6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:01:33.904974 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-ae797d6b-04f6-4ac3-bc41-89acfeae73d6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1442 microversion: 2.1 time: 0.155770 Aug 24 18:01:33.905543 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 584/1171] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:01:33 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1442 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:35.839480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-a131bc56-0532-488c-b29f-673557e55e4b req-3c330228-56c1-4de5-a953-a777bdedec28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c9a68f-596d-421a-9bed-61eb25b228ba", "tag": "039281e4-0f6b-49b6-9977-c41fac97b0ae"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 18:01:35.849226 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-a131bc56-0532-488c-b29f-673557e55e4b req-3c330228-56c1-4de5-a953-a777bdedec28 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:01:35.849706 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-a131bc56-0532-488c-b29f-673557e55e4b req-3c330228-56c1-4de5-a953-a777bdedec28 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:01:35.850169 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-a131bc56-0532-488c-b29f-673557e55e4b req-3c330228-56c1-4de5-a953-a777bdedec28 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:01:35.861415 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-a131bc56-0532-488c-b29f-673557e55e4b req-3c330228-56c1-4de5-a953-a777bdedec28 service nova] Creating event network-changed:039281e4-0f6b-49b6-9977-c41fac97b0ae for instance 24c9a68f-596d-421a-9bed-61eb25b228ba on hv-cinder-85442 Aug 24 18:01:35.866260 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-a131bc56-0532-488c-b29f-673557e55e4b req-3c330228-56c1-4de5-a953-a777bdedec28 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030445 Aug 24 18:01:35.866859 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 588/1172] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 18:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 18:02:37.106774 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:02:37.107753 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Wed Aug 24 18:02:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:03:09.919563 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:03:09.920121 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Wed Aug 24 18:03:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:03:30.197153 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:30.198288 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=56 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:30.202555 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-a2e09564-5b39-4f73-ac78-59e599e37e42 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 18:03:30.203093 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-a2e09564-5b39-4f73-ac78-59e599e37e42 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:30.210084 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a2e09564-5b39-4f73-ac78-59e599e37e42 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:30.210577 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a2e09564-5b39-4f73-ac78-59e599e37e42 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:30.211017 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a2e09564-5b39-4f73-ac78-59e599e37e42 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:30.211874 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a2e09564-5b39-4f73-ac78-59e599e37e42 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:30.212333 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a2e09564-5b39-4f73-ac78-59e599e37e42 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:30.212758 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-a2e09564-5b39-4f73-ac78-59e599e37e42 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:30.240829 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.objects.instance [None req-a2e09564-5b39-4f73-ac78-59e599e37e42 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lazy-loading 'flavor' on Instance uuid 24c9a68f-596d-421a-9bed-61eb25b228ba {{(pid=127676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 18:03:30.593325 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-a2e09564-5b39-4f73-ac78-59e599e37e42 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "POST /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba/action" status: 202 len: 0 microversion: 2.1 time: 0.397744 Aug 24 18:03:30.593860 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 585/1173] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 18:03:30 2022] POST /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 18:03:30.600713 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d25a506d-b55c-4f6a-a1c6-173914c068ef] AMQP server on 10.222.0.76:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 18:03:30.601256 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=22 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:30.602033 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=42 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:30.606565 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-b2bbec24-0ee4-4c31-960a-fb75b3ed334d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:30.607415 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-b2bbec24-0ee4-4c31-960a-fb75b3ed334d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:30.613503 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b2bbec24-0ee4-4c31-960a-fb75b3ed334d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:30.614109 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b2bbec24-0ee4-4c31-960a-fb75b3ed334d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:30.614631 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b2bbec24-0ee4-4c31-960a-fb75b3ed334d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:30.615338 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b2bbec24-0ee4-4c31-960a-fb75b3ed334d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:30.615796 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b2bbec24-0ee4-4c31-960a-fb75b3ed334d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:30.616263 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-b2bbec24-0ee4-4c31-960a-fb75b3ed334d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:30.763517 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-b2bbec24-0ee4-4c31-960a-fb75b3ed334d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:30.771457 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-b2bbec24-0ee4-4c31-960a-fb75b3ed334d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1566 microversion: 2.1 time: 0.172847 Aug 24 18:03:30.772011 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 589/1174] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:30 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 18:03:31.794041 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-cf7e4544-86a5-4d0a-bf99-3990793f9cb7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:31.794753 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-cf7e4544-86a5-4d0a-bf99-3990793f9cb7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:31.801164 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cf7e4544-86a5-4d0a-bf99-3990793f9cb7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:31.801652 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cf7e4544-86a5-4d0a-bf99-3990793f9cb7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:31.802114 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cf7e4544-86a5-4d0a-bf99-3990793f9cb7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:31.802805 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cf7e4544-86a5-4d0a-bf99-3990793f9cb7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:31.803258 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cf7e4544-86a5-4d0a-bf99-3990793f9cb7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:31.803679 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cf7e4544-86a5-4d0a-bf99-3990793f9cb7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:31.939704 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-cf7e4544-86a5-4d0a-bf99-3990793f9cb7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:31.948453 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-cf7e4544-86a5-4d0a-bf99-3990793f9cb7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1566 microversion: 2.1 time: 0.159383 Aug 24 18:03:31.949029 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 586/1175] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:31 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:32.970437 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-9a3e4b2b-f669-4bbc-98e8-fdb71ef9e80e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:32.971049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-9a3e4b2b-f669-4bbc-98e8-fdb71ef9e80e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:32.979989 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9a3e4b2b-f669-4bbc-98e8-fdb71ef9e80e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:32.980474 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9a3e4b2b-f669-4bbc-98e8-fdb71ef9e80e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:32.980917 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9a3e4b2b-f669-4bbc-98e8-fdb71ef9e80e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:32.981621 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9a3e4b2b-f669-4bbc-98e8-fdb71ef9e80e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:32.982108 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9a3e4b2b-f669-4bbc-98e8-fdb71ef9e80e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:32.982539 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-9a3e4b2b-f669-4bbc-98e8-fdb71ef9e80e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:32.988468 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO oslo.messaging._drivers.impl_rabbit [-] [d25a506d-b55c-4f6a-a1c6-173914c068ef] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 33584. Aug 24 18:03:33.124055 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-9a3e4b2b-f669-4bbc-98e8-fdb71ef9e80e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:33.132364 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-9a3e4b2b-f669-4bbc-98e8-fdb71ef9e80e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1566 microversion: 2.1 time: 0.165745 Aug 24 18:03:33.142268 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 590/1176] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:32 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:34.154772 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5b678824-37ee-430e-ac18-274307f2518d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:34.155377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5b678824-37ee-430e-ac18-274307f2518d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:34.162344 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b678824-37ee-430e-ac18-274307f2518d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:34.162832 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b678824-37ee-430e-ac18-274307f2518d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:34.163266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b678824-37ee-430e-ac18-274307f2518d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:34.164054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b678824-37ee-430e-ac18-274307f2518d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:34.164590 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b678824-37ee-430e-ac18-274307f2518d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:34.165024 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b678824-37ee-430e-ac18-274307f2518d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:34.300315 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-5b678824-37ee-430e-ac18-274307f2518d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:34.308383 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5b678824-37ee-430e-ac18-274307f2518d tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1566 microversion: 2.1 time: 0.157465 Aug 24 18:03:34.308957 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 587/1177] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:34 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:35.329751 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-1c32c1e7-6e00-4a15-8229-96a768df6156 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:35.330397 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-1c32c1e7-6e00-4a15-8229-96a768df6156 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:35.337945 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1c32c1e7-6e00-4a15-8229-96a768df6156 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:35.338433 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1c32c1e7-6e00-4a15-8229-96a768df6156 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:35.338873 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1c32c1e7-6e00-4a15-8229-96a768df6156 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:35.339570 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1c32c1e7-6e00-4a15-8229-96a768df6156 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:35.340029 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1c32c1e7-6e00-4a15-8229-96a768df6156 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:35.340458 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-1c32c1e7-6e00-4a15-8229-96a768df6156 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:35.478050 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-1c32c1e7-6e00-4a15-8229-96a768df6156 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:35.485743 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-1c32c1e7-6e00-4a15-8229-96a768df6156 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1566 microversion: 2.1 time: 0.159966 Aug 24 18:03:35.486343 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 591/1178] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:35 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:36.507872 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-3e39dbee-3360-4e45-b98f-69f173ba3a89 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:36.508494 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-3e39dbee-3360-4e45-b98f-69f173ba3a89 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:36.515108 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3e39dbee-3360-4e45-b98f-69f173ba3a89 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:36.515596 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3e39dbee-3360-4e45-b98f-69f173ba3a89 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:36.516046 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3e39dbee-3360-4e45-b98f-69f173ba3a89 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:36.516739 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3e39dbee-3360-4e45-b98f-69f173ba3a89 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:36.517200 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3e39dbee-3360-4e45-b98f-69f173ba3a89 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:36.517631 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-3e39dbee-3360-4e45-b98f-69f173ba3a89 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:36.650296 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-3e39dbee-3360-4e45-b98f-69f173ba3a89 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:36.658222 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-3e39dbee-3360-4e45-b98f-69f173ba3a89 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1566 microversion: 2.1 time: 0.154303 Aug 24 18:03:36.658920 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 588/1179] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:36 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:37.679462 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-2e7d7707-8136-4d45-bc08-6af47db5b147 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:37.680070 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-2e7d7707-8136-4d45-bc08-6af47db5b147 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:37.686531 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2e7d7707-8136-4d45-bc08-6af47db5b147 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:37.687019 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2e7d7707-8136-4d45-bc08-6af47db5b147 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:37.687457 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2e7d7707-8136-4d45-bc08-6af47db5b147 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:37.688152 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2e7d7707-8136-4d45-bc08-6af47db5b147 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:37.688612 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2e7d7707-8136-4d45-bc08-6af47db5b147 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:37.689040 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2e7d7707-8136-4d45-bc08-6af47db5b147 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:37.824612 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-2e7d7707-8136-4d45-bc08-6af47db5b147 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:37.833049 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-2e7d7707-8136-4d45-bc08-6af47db5b147 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1566 microversion: 2.1 time: 0.157394 Aug 24 18:03:37.833617 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 592/1180] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:37 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 18:03:38.855059 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-515ebede-b4ff-4c2b-b9ff-5cbc1dad9725 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:38.855681 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-515ebede-b4ff-4c2b-b9ff-5cbc1dad9725 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:38.862659 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-515ebede-b4ff-4c2b-b9ff-5cbc1dad9725 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:38.863152 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-515ebede-b4ff-4c2b-b9ff-5cbc1dad9725 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:38.863622 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-515ebede-b4ff-4c2b-b9ff-5cbc1dad9725 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:38.864321 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-515ebede-b4ff-4c2b-b9ff-5cbc1dad9725 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:38.864785 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-515ebede-b4ff-4c2b-b9ff-5cbc1dad9725 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:38.865215 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-515ebede-b4ff-4c2b-b9ff-5cbc1dad9725 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:39.000434 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-515ebede-b4ff-4c2b-b9ff-5cbc1dad9725 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:39.008570 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-515ebede-b4ff-4c2b-b9ff-5cbc1dad9725 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1566 microversion: 2.1 time: 0.157720 Aug 24 18:03:39.009136 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 589/1181] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:38 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:40.030252 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-5c26a769-312f-4b31-a812-9f7c9ca5671a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:40.030864 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-5c26a769-312f-4b31-a812-9f7c9ca5671a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:40.037585 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5c26a769-312f-4b31-a812-9f7c9ca5671a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:40.038103 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5c26a769-312f-4b31-a812-9f7c9ca5671a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:40.038557 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5c26a769-312f-4b31-a812-9f7c9ca5671a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:40.039250 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5c26a769-312f-4b31-a812-9f7c9ca5671a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:40.039705 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5c26a769-312f-4b31-a812-9f7c9ca5671a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:40.040127 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5c26a769-312f-4b31-a812-9f7c9ca5671a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:40.173653 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5c26a769-312f-4b31-a812-9f7c9ca5671a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:40.182626 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-5c26a769-312f-4b31-a812-9f7c9ca5671a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1566 microversion: 2.1 time: 0.156153 Aug 24 18:03:40.183281 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 593/1182] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:40 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:41.205000 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-57b938d6-f986-49e0-b7d6-41f792e98a7c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:41.206331 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-57b938d6-f986-49e0-b7d6-41f792e98a7c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:41.213134 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57b938d6-f986-49e0-b7d6-41f792e98a7c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:41.213623 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57b938d6-f986-49e0-b7d6-41f792e98a7c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:41.214096 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57b938d6-f986-49e0-b7d6-41f792e98a7c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:41.214798 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57b938d6-f986-49e0-b7d6-41f792e98a7c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:41.215247 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57b938d6-f986-49e0-b7d6-41f792e98a7c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:41.215674 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-57b938d6-f986-49e0-b7d6-41f792e98a7c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:41.428989 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-57b938d6-f986-49e0-b7d6-41f792e98a7c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:41.437676 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-57b938d6-f986-49e0-b7d6-41f792e98a7c tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1566 microversion: 2.1 time: 0.236726 Aug 24 18:03:41.438286 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 590/1183] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:41 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1566 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:42.460380 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-8bebff5a-3299-4c12-92ad-09d1efb5588e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:42.463026 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-8bebff5a-3299-4c12-92ad-09d1efb5588e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:42.467959 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8bebff5a-3299-4c12-92ad-09d1efb5588e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:42.468447 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8bebff5a-3299-4c12-92ad-09d1efb5588e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:42.468888 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8bebff5a-3299-4c12-92ad-09d1efb5588e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:42.469700 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8bebff5a-3299-4c12-92ad-09d1efb5588e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:42.470192 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8bebff5a-3299-4c12-92ad-09d1efb5588e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:42.470627 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-8bebff5a-3299-4c12-92ad-09d1efb5588e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:42.604127 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-8bebff5a-3299-4c12-92ad-09d1efb5588e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:42.611969 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-8bebff5a-3299-4c12-92ad-09d1efb5588e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1566 microversion: 2.1 time: 0.156195 Aug 24 18:03:42.612531 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 594/1184] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:42 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:43.633183 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-2ea27fb2-13c9-4a62-b7d7-11f591274890 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:43.633770 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-2ea27fb2-13c9-4a62-b7d7-11f591274890 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:43.640425 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2ea27fb2-13c9-4a62-b7d7-11f591274890 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:43.640932 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2ea27fb2-13c9-4a62-b7d7-11f591274890 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:43.641363 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2ea27fb2-13c9-4a62-b7d7-11f591274890 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:43.642092 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2ea27fb2-13c9-4a62-b7d7-11f591274890 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:43.642550 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2ea27fb2-13c9-4a62-b7d7-11f591274890 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:43.642973 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-2ea27fb2-13c9-4a62-b7d7-11f591274890 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:43.783389 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-2ea27fb2-13c9-4a62-b7d7-11f591274890 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:43.791852 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-2ea27fb2-13c9-4a62-b7d7-11f591274890 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1567 microversion: 2.1 time: 0.162621 Aug 24 18:03:43.792412 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 591/1185] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:43 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:43.812169 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-ecbfdff0-5ffe-4e02-a0db-deef01e671cb tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 18:03:43.812737 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ecbfdff0-5ffe-4e02-a0db-deef01e671cb tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:43.820215 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ecbfdff0-5ffe-4e02-a0db-deef01e671cb tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:43.820691 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ecbfdff0-5ffe-4e02-a0db-deef01e671cb tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:43.821122 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ecbfdff0-5ffe-4e02-a0db-deef01e671cb tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:43.821818 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ecbfdff0-5ffe-4e02-a0db-deef01e671cb tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:43.822283 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ecbfdff0-5ffe-4e02-a0db-deef01e671cb tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:43.822700 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-ecbfdff0-5ffe-4e02-a0db-deef01e671cb tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:43.855514 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-ecbfdff0-5ffe-4e02-a0db-deef01e671cb tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127677) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 18:03:44.140804 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ecbfdff0-5ffe-4e02-a0db-deef01e671cb tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [4d4ba482-221d-417e-af1d-ea82b39f4782] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 18:03:45.148068 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO oslo.messaging._drivers.impl_rabbit [None req-ecbfdff0-5ffe-4e02-a0db-deef01e671cb tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [4d4ba482-221d-417e-af1d-ea82b39f4782] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 33610. Aug 24 18:03:45.151195 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-ecbfdff0-5ffe-4e02-a0db-deef01e671cb tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "POST /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba/action" status: 202 len: 0 microversion: 2.1 time: 1.343136 Aug 24 18:03:45.151803 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 595/1186] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 18:03:43 2022] POST /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba/action => generated 0 bytes in 1344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 18:03:45.159955 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-7a1dc3e8-9ebf-45b7-b8a7-b3e771ff7094 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:45.161715 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-7a1dc3e8-9ebf-45b7-b8a7-b3e771ff7094 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:45.168211 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7a1dc3e8-9ebf-45b7-b8a7-b3e771ff7094 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:45.168740 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7a1dc3e8-9ebf-45b7-b8a7-b3e771ff7094 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:45.169119 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7a1dc3e8-9ebf-45b7-b8a7-b3e771ff7094 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:45.169980 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7a1dc3e8-9ebf-45b7-b8a7-b3e771ff7094 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:45.170281 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7a1dc3e8-9ebf-45b7-b8a7-b3e771ff7094 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:45.170700 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-7a1dc3e8-9ebf-45b7-b8a7-b3e771ff7094 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:45.309970 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-7a1dc3e8-9ebf-45b7-b8a7-b3e771ff7094 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:45.319610 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-7a1dc3e8-9ebf-45b7-b8a7-b3e771ff7094 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1515 microversion: 2.1 time: 0.163478 Aug 24 18:03:45.320201 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 592/1187] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:45 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 18:03:45.783789 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-12d01175-a0f9-4dfa-8e44-b01022a3b0dc req-b6d2f32e-b1c5-4bea-9d2a-d5d09abeea48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c9a68f-596d-421a-9bed-61eb25b228ba", "name": "network-vif-unplugged", "status": "completed", "tag": "039281e4-0f6b-49b6-9977-c41fac97b0ae"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 18:03:45.795002 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-12d01175-a0f9-4dfa-8e44-b01022a3b0dc req-b6d2f32e-b1c5-4bea-9d2a-d5d09abeea48 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:45.795474 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-12d01175-a0f9-4dfa-8e44-b01022a3b0dc req-b6d2f32e-b1c5-4bea-9d2a-d5d09abeea48 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:45.795900 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-12d01175-a0f9-4dfa-8e44-b01022a3b0dc req-b6d2f32e-b1c5-4bea-9d2a-d5d09abeea48 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:45.806522 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.compute.server_external_events [req-12d01175-a0f9-4dfa-8e44-b01022a3b0dc req-b6d2f32e-b1c5-4bea-9d2a-d5d09abeea48 service nova] Unable to find a host for instance 24c9a68f-596d-421a-9bed-61eb25b228ba. Dropping event network-vif-unplugged {{(pid=127677) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 18:03:45.807396 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-12d01175-a0f9-4dfa-8e44-b01022a3b0dc req-b6d2f32e-b1c5-4bea-9d2a-d5d09abeea48 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027577 Aug 24 18:03:45.807965 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 596/1188] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 18:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 18:03:46.342237 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-1a74bde2-6b46-4585-bfab-5b961a9cfdbe tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:46.342786 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-1a74bde2-6b46-4585-bfab-5b961a9cfdbe tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:46.349881 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1a74bde2-6b46-4585-bfab-5b961a9cfdbe tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:46.350380 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1a74bde2-6b46-4585-bfab-5b961a9cfdbe tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:46.350822 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1a74bde2-6b46-4585-bfab-5b961a9cfdbe tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:46.351513 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1a74bde2-6b46-4585-bfab-5b961a9cfdbe tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:46.351969 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1a74bde2-6b46-4585-bfab-5b961a9cfdbe tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:46.352396 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-1a74bde2-6b46-4585-bfab-5b961a9cfdbe tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:46.493069 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-1a74bde2-6b46-4585-bfab-5b961a9cfdbe tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:46.502183 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-1a74bde2-6b46-4585-bfab-5b961a9cfdbe tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1515 microversion: 2.1 time: 0.163657 Aug 24 18:03:46.502982 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 593/1189] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:46 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:47.524270 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-5a9a8f2f-41db-4ae1-9567-cbfa983a6029 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:47.524860 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-5a9a8f2f-41db-4ae1-9567-cbfa983a6029 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:47.531291 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5a9a8f2f-41db-4ae1-9567-cbfa983a6029 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:47.531778 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5a9a8f2f-41db-4ae1-9567-cbfa983a6029 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:47.532220 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5a9a8f2f-41db-4ae1-9567-cbfa983a6029 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:47.532908 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5a9a8f2f-41db-4ae1-9567-cbfa983a6029 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:47.533354 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5a9a8f2f-41db-4ae1-9567-cbfa983a6029 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:47.533777 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-5a9a8f2f-41db-4ae1-9567-cbfa983a6029 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:47.668444 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-5a9a8f2f-41db-4ae1-9567-cbfa983a6029 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:47.677127 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-5a9a8f2f-41db-4ae1-9567-cbfa983a6029 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1515 microversion: 2.1 time: 0.156676 Aug 24 18:03:47.677703 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 597/1190] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:47 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:48.698670 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-ef230954-4b54-4e58-86dd-b06607171be3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:48.699352 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-ef230954-4b54-4e58-86dd-b06607171be3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:48.705624 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ef230954-4b54-4e58-86dd-b06607171be3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:48.706142 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ef230954-4b54-4e58-86dd-b06607171be3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:48.706588 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ef230954-4b54-4e58-86dd-b06607171be3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:48.707337 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ef230954-4b54-4e58-86dd-b06607171be3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:48.707797 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ef230954-4b54-4e58-86dd-b06607171be3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:48.708228 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-ef230954-4b54-4e58-86dd-b06607171be3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:48.841479 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-ef230954-4b54-4e58-86dd-b06607171be3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:48.849498 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-ef230954-4b54-4e58-86dd-b06607171be3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1515 microversion: 2.1 time: 0.154695 Aug 24 18:03:48.850103 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 594/1191] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:48 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:49.870961 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-0d89cbdf-2b18-4325-ba28-89f16e6b8f08 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:49.871493 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-0d89cbdf-2b18-4325-ba28-89f16e6b8f08 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:49.878335 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0d89cbdf-2b18-4325-ba28-89f16e6b8f08 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:49.879582 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0d89cbdf-2b18-4325-ba28-89f16e6b8f08 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:49.880072 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0d89cbdf-2b18-4325-ba28-89f16e6b8f08 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:49.880784 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0d89cbdf-2b18-4325-ba28-89f16e6b8f08 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:49.881229 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0d89cbdf-2b18-4325-ba28-89f16e6b8f08 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:49.881661 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-0d89cbdf-2b18-4325-ba28-89f16e6b8f08 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:50.014076 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-0d89cbdf-2b18-4325-ba28-89f16e6b8f08 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:50.022661 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-0d89cbdf-2b18-4325-ba28-89f16e6b8f08 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1515 microversion: 2.1 time: 0.155697 Aug 24 18:03:50.023226 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 598/1192] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:49 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:51.043635 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-cc3d5185-6fca-45ea-a67c-19ccd8842da3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:51.044245 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-cc3d5185-6fca-45ea-a67c-19ccd8842da3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:51.051233 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cc3d5185-6fca-45ea-a67c-19ccd8842da3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:51.052008 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cc3d5185-6fca-45ea-a67c-19ccd8842da3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:51.052502 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cc3d5185-6fca-45ea-a67c-19ccd8842da3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:51.053133 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cc3d5185-6fca-45ea-a67c-19ccd8842da3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:51.053607 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cc3d5185-6fca-45ea-a67c-19ccd8842da3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:51.054053 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-cc3d5185-6fca-45ea-a67c-19ccd8842da3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:51.193871 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-cc3d5185-6fca-45ea-a67c-19ccd8842da3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:51.202801 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-cc3d5185-6fca-45ea-a67c-19ccd8842da3 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1517 microversion: 2.1 time: 0.162823 Aug 24 18:03:51.203261 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 595/1193] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:51 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:52.224867 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-4217fd1f-443b-40d3-a42c-82b54c769f97 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:52.225371 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-4217fd1f-443b-40d3-a42c-82b54c769f97 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:52.231865 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4217fd1f-443b-40d3-a42c-82b54c769f97 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:52.232352 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4217fd1f-443b-40d3-a42c-82b54c769f97 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:52.232792 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4217fd1f-443b-40d3-a42c-82b54c769f97 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:52.233491 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4217fd1f-443b-40d3-a42c-82b54c769f97 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:52.233977 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4217fd1f-443b-40d3-a42c-82b54c769f97 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:52.234414 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-4217fd1f-443b-40d3-a42c-82b54c769f97 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:52.718082 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-4217fd1f-443b-40d3-a42c-82b54c769f97 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:52.726686 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-4217fd1f-443b-40d3-a42c-82b54c769f97 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1573 microversion: 2.1 time: 0.505983 Aug 24 18:03:52.727264 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 599/1194] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:52 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1573 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:53.748100 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-dc9a3054-0e9c-4955-8382-709f71aff644 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:53.752552 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-dc9a3054-0e9c-4955-8382-709f71aff644 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:53.756031 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-dc9a3054-0e9c-4955-8382-709f71aff644 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:53.756517 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-dc9a3054-0e9c-4955-8382-709f71aff644 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:53.756954 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-dc9a3054-0e9c-4955-8382-709f71aff644 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:53.757651 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-dc9a3054-0e9c-4955-8382-709f71aff644 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:53.758142 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-dc9a3054-0e9c-4955-8382-709f71aff644 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:53.758570 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-dc9a3054-0e9c-4955-8382-709f71aff644 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:53.898847 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-dc9a3054-0e9c-4955-8382-709f71aff644 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:53.906851 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-dc9a3054-0e9c-4955-8382-709f71aff644 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1573 microversion: 2.1 time: 0.162681 Aug 24 18:03:53.907431 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 596/1195] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:53 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:54.928900 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-44273af8-08fa-477b-af91-c71cb9845f8a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:54.929519 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-44273af8-08fa-477b-af91-c71cb9845f8a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:54.936622 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-44273af8-08fa-477b-af91-c71cb9845f8a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:54.937193 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-44273af8-08fa-477b-af91-c71cb9845f8a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:54.937655 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-44273af8-08fa-477b-af91-c71cb9845f8a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:54.938379 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-44273af8-08fa-477b-af91-c71cb9845f8a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:54.938840 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-44273af8-08fa-477b-af91-c71cb9845f8a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:54.939269 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-44273af8-08fa-477b-af91-c71cb9845f8a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:55.075648 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-44273af8-08fa-477b-af91-c71cb9845f8a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:55.084341 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-44273af8-08fa-477b-af91-c71cb9845f8a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1573 microversion: 2.1 time: 0.159670 Aug 24 18:03:55.084902 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 600/1196] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:54 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:56.105089 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-449caeb4-b3fd-4d8f-a588-b7ada1aca1e2 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:56.105882 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-449caeb4-b3fd-4d8f-a588-b7ada1aca1e2 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:56.112266 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-449caeb4-b3fd-4d8f-a588-b7ada1aca1e2 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:56.112741 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-449caeb4-b3fd-4d8f-a588-b7ada1aca1e2 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:56.113955 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-449caeb4-b3fd-4d8f-a588-b7ada1aca1e2 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:56.114860 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-449caeb4-b3fd-4d8f-a588-b7ada1aca1e2 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:56.115310 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-449caeb4-b3fd-4d8f-a588-b7ada1aca1e2 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:56.115757 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-449caeb4-b3fd-4d8f-a588-b7ada1aca1e2 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:56.250979 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-449caeb4-b3fd-4d8f-a588-b7ada1aca1e2 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:56.256731 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-449caeb4-b3fd-4d8f-a588-b7ada1aca1e2 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1573 microversion: 2.1 time: 0.155536 Aug 24 18:03:56.257308 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 597/1197] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:56 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:57.278542 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-225c14ce-52a4-414f-9daa-06f5194dbb5e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:57.279150 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-225c14ce-52a4-414f-9daa-06f5194dbb5e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:57.285480 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-225c14ce-52a4-414f-9daa-06f5194dbb5e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:57.286431 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-225c14ce-52a4-414f-9daa-06f5194dbb5e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:57.286431 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-225c14ce-52a4-414f-9daa-06f5194dbb5e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:57.288019 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-225c14ce-52a4-414f-9daa-06f5194dbb5e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:57.288472 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-225c14ce-52a4-414f-9daa-06f5194dbb5e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:57.288892 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-225c14ce-52a4-414f-9daa-06f5194dbb5e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:57.419764 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-225c14ce-52a4-414f-9daa-06f5194dbb5e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:57.427646 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-225c14ce-52a4-414f-9daa-06f5194dbb5e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1573 microversion: 2.1 time: 0.152732 Aug 24 18:03:57.428381 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 601/1198] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:57 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:58.449362 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-0360bd65-ceed-41a0-8593-4aabb48a28d5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:58.449941 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-0360bd65-ceed-41a0-8593-4aabb48a28d5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:58.456422 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0360bd65-ceed-41a0-8593-4aabb48a28d5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:58.456863 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0360bd65-ceed-41a0-8593-4aabb48a28d5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:58.457223 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0360bd65-ceed-41a0-8593-4aabb48a28d5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:58.457953 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0360bd65-ceed-41a0-8593-4aabb48a28d5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:58.458469 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0360bd65-ceed-41a0-8593-4aabb48a28d5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:58.459216 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-0360bd65-ceed-41a0-8593-4aabb48a28d5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:58.597845 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-0360bd65-ceed-41a0-8593-4aabb48a28d5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:58.605668 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-0360bd65-ceed-41a0-8593-4aabb48a28d5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1573 microversion: 2.1 time: 0.160268 Aug 24 18:03:58.606252 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 598/1199] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:58 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:03:59.627239 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-577d6fed-9e20-4666-b202-18d4ea732ed7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:03:59.627850 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-577d6fed-9e20-4666-b202-18d4ea732ed7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:03:59.634346 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-577d6fed-9e20-4666-b202-18d4ea732ed7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:59.634829 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-577d6fed-9e20-4666-b202-18d4ea732ed7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:59.635265 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-577d6fed-9e20-4666-b202-18d4ea732ed7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:59.635950 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-577d6fed-9e20-4666-b202-18d4ea732ed7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:03:59.636406 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-577d6fed-9e20-4666-b202-18d4ea732ed7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:03:59.636830 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-577d6fed-9e20-4666-b202-18d4ea732ed7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:03:59.770235 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-577d6fed-9e20-4666-b202-18d4ea732ed7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:03:59.779318 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-577d6fed-9e20-4666-b202-18d4ea732ed7 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1573 microversion: 2.1 time: 0.156244 Aug 24 18:03:59.779968 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 602/1200] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:03:59 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:04:00.800837 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-68656200-7d0d-4398-b0f0-18edd3dd06e5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:04:00.801456 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-68656200-7d0d-4398-b0f0-18edd3dd06e5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:04:00.804148 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=29 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:00.809110 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-68656200-7d0d-4398-b0f0-18edd3dd06e5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:04:00.809605 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-68656200-7d0d-4398-b0f0-18edd3dd06e5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:04:00.810111 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-68656200-7d0d-4398-b0f0-18edd3dd06e5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:04:00.810906 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-68656200-7d0d-4398-b0f0-18edd3dd06e5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:04:00.811464 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-68656200-7d0d-4398-b0f0-18edd3dd06e5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:04:00.811940 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-68656200-7d0d-4398-b0f0-18edd3dd06e5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:04:00.816035 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:00.951512 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-68656200-7d0d-4398-b0f0-18edd3dd06e5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:04:00.960302 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-68656200-7d0d-4398-b0f0-18edd3dd06e5 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1573 microversion: 2.1 time: 0.163377 Aug 24 18:04:00.962833 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 599/1201] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:04:00 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:04:01.889067 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [req-87061b92-0161-4a3f-be90-ee67df0d8483 req-86877f03-431f-4900-b4e6-f414b4e6cced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c9a68f-596d-421a-9bed-61eb25b228ba", "name": "network-vif-plugged", "status": "completed", "tag": "039281e4-0f6b-49b6-9977-c41fac97b0ae"}]} {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 18:04:01.903832 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:01.903832 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-87061b92-0161-4a3f-be90-ee67df0d8483 req-86877f03-431f-4900-b4e6-f414b4e6cced service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:04:01.903832 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-87061b92-0161-4a3f-be90-ee67df0d8483 req-86877f03-431f-4900-b4e6-f414b4e6cced service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:04:01.903832 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [req-87061b92-0161-4a3f-be90-ee67df0d8483 req-86877f03-431f-4900-b4e6-f414b4e6cced service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:04:01.904835 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:01.912649 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.compute.server_external_events [req-87061b92-0161-4a3f-be90-ee67df0d8483 req-86877f03-431f-4900-b4e6-f414b4e6cced service nova] Creating event network-vif-plugged:039281e4-0f6b-49b6-9977-c41fac97b0ae for instance 24c9a68f-596d-421a-9bed-61eb25b228ba on hv-cinder-85442 Aug 24 18:04:01.918283 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [req-87061b92-0161-4a3f-be90-ee67df0d8483 req-86877f03-431f-4900-b4e6-f414b4e6cced service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032820 Aug 24 18:04:01.919635 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 603/1202] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 18:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 18:04:01.981144 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-d872f645-0a26-490f-b1fd-51baad91906a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:04:01.981930 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-d872f645-0a26-490f-b1fd-51baad91906a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:04:01.990099 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d872f645-0a26-490f-b1fd-51baad91906a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:04:01.990099 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d872f645-0a26-490f-b1fd-51baad91906a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:04:01.990099 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d872f645-0a26-490f-b1fd-51baad91906a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:04:01.990463 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d872f645-0a26-490f-b1fd-51baad91906a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:04:01.990667 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d872f645-0a26-490f-b1fd-51baad91906a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:04:01.991052 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-d872f645-0a26-490f-b1fd-51baad91906a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:04:02.131767 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-d872f645-0a26-490f-b1fd-51baad91906a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:04:02.141036 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-d872f645-0a26-490f-b1fd-51baad91906a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1573 microversion: 2.1 time: 0.163790 Aug 24 18:04:02.141603 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 600/1203] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:04:01 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:04:03.165178 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-441f9ef3-0c47-4db7-81c2-8848f468e90b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:04:03.165821 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-441f9ef3-0c47-4db7-81c2-8848f468e90b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:04:03.173409 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-441f9ef3-0c47-4db7-81c2-8848f468e90b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:04:03.173980 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-441f9ef3-0c47-4db7-81c2-8848f468e90b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:04:03.174463 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-441f9ef3-0c47-4db7-81c2-8848f468e90b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:04:03.178787 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-441f9ef3-0c47-4db7-81c2-8848f468e90b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:04:03.179274 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-441f9ef3-0c47-4db7-81c2-8848f468e90b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:04:03.179722 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-441f9ef3-0c47-4db7-81c2-8848f468e90b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:04:03.318819 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-441f9ef3-0c47-4db7-81c2-8848f468e90b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:04:03.326501 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-441f9ef3-0c47-4db7-81c2-8848f468e90b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1573 microversion: 2.1 time: 0.167387 Aug 24 18:04:03.327070 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 604/1204] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:04:03 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:04:04.347551 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-4ad2ccd3-6f79-4fb7-912d-39020a5c823b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:04:04.348159 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-4ad2ccd3-6f79-4fb7-912d-39020a5c823b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:04:04.355841 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4ad2ccd3-6f79-4fb7-912d-39020a5c823b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:04:04.356316 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4ad2ccd3-6f79-4fb7-912d-39020a5c823b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:04:04.356747 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4ad2ccd3-6f79-4fb7-912d-39020a5c823b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:04:04.357430 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4ad2ccd3-6f79-4fb7-912d-39020a5c823b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:04:04.357899 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4ad2ccd3-6f79-4fb7-912d-39020a5c823b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:04:04.358327 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-4ad2ccd3-6f79-4fb7-912d-39020a5c823b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:04:04.489725 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-4ad2ccd3-6f79-4fb7-912d-39020a5c823b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:04:04.497696 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-4ad2ccd3-6f79-4fb7-912d-39020a5c823b tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1560 microversion: 2.1 time: 0.154128 Aug 24 18:04:04.498282 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 601/1205] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:04:04 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:04:32.113404 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:04:32.114054 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Wed Aug 24 18:04:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:05:17.134676 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG dbcounter [-] [127677] Writing DB stats nova_api:SELECT=3 {{(pid=127677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:17.139920 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-2a9005d3-4baa-4339-b484-93df9e86f6ee tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:05:17.140569 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-2a9005d3-4baa-4339-b484-93df9e86f6ee tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:05:17.140831 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-fc05077b-e90d-4b6b-b096-c42f81fca4de req-7dcb01ec-01b2-46ea-bed6-4c08f2201ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c9a68f-596d-421a-9bed-61eb25b228ba", "tag": "039281e4-0f6b-49b6-9977-c41fac97b0ae"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 18:05:17.146668 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_api:SELECT=5 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:17.147329 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG dbcounter [-] [127676] Writing DB stats nova_cell1:SELECT=17 {{(pid=127676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:17.149818 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2a9005d3-4baa-4339-b484-93df9e86f6ee tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:05:17.150514 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2a9005d3-4baa-4339-b484-93df9e86f6ee tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:05:17.151078 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2a9005d3-4baa-4339-b484-93df9e86f6ee tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:05:17.151867 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2a9005d3-4baa-4339-b484-93df9e86f6ee tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:05:17.152391 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2a9005d3-4baa-4339-b484-93df9e86f6ee tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:05:17.152890 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-2a9005d3-4baa-4339-b484-93df9e86f6ee tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:05:17.153207 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-fc05077b-e90d-4b6b-b096-c42f81fca4de req-7dcb01ec-01b2-46ea-bed6-4c08f2201ff8 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:05:17.153685 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-fc05077b-e90d-4b6b-b096-c42f81fca4de req-7dcb01ec-01b2-46ea-bed6-4c08f2201ff8 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:05:17.154147 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-fc05077b-e90d-4b6b-b096-c42f81fca4de req-7dcb01ec-01b2-46ea-bed6-4c08f2201ff8 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:05:17.166419 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-fc05077b-e90d-4b6b-b096-c42f81fca4de req-7dcb01ec-01b2-46ea-bed6-4c08f2201ff8 service nova] Creating event network-changed:039281e4-0f6b-49b6-9977-c41fac97b0ae for instance 24c9a68f-596d-421a-9bed-61eb25b228ba on hv-cinder-85442 Aug 24 18:05:17.171594 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-fc05077b-e90d-4b6b-b096-c42f81fca4de req-7dcb01ec-01b2-46ea-bed6-4c08f2201ff8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035277 Aug 24 18:05:17.172384 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 602/1206] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 18:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 18:05:17.182869 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-2a9005d3-4baa-4339-b484-93df9e86f6ee tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Going to try to terminate instance {{(pid=127677) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 18:05:17.457785 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-2a9005d3-4baa-4339-b484-93df9e86f6ee tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "DELETE /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 204 len: 0 microversion: 2.1 time: 0.325488 Aug 24 18:05:17.458462 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 605/1207] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 18:05:17 2022] DELETE /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 18:05:17.468275 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-44ffd196-339f-4098-b5d5-36d8f8281992 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:05:17.469255 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-44ffd196-339f-4098-b5d5-36d8f8281992 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:05:17.475552 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-44ffd196-339f-4098-b5d5-36d8f8281992 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:05:17.476041 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-44ffd196-339f-4098-b5d5-36d8f8281992 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:05:17.476992 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-44ffd196-339f-4098-b5d5-36d8f8281992 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:05:17.477692 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-44ffd196-339f-4098-b5d5-36d8f8281992 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:05:17.478377 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-44ffd196-339f-4098-b5d5-36d8f8281992 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:05:17.479019 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-44ffd196-339f-4098-b5d5-36d8f8281992 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:05:17.663590 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.policy [None req-44ffd196-339f-4098-b5d5-36d8f8281992 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:05:17.672093 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-44ffd196-339f-4098-b5d5-36d8f8281992 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1566 microversion: 2.1 time: 0.208878 Aug 24 18:05:17.672744 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 603/1208] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:05:17 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1566 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:05:18.694060 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-a075feff-9af3-4879-bd25-4ef641970c46 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:05:18.694770 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-a075feff-9af3-4879-bd25-4ef641970c46 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:05:18.701726 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a075feff-9af3-4879-bd25-4ef641970c46 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:05:18.702235 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a075feff-9af3-4879-bd25-4ef641970c46 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:05:18.702669 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a075feff-9af3-4879-bd25-4ef641970c46 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:05:18.703724 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a075feff-9af3-4879-bd25-4ef641970c46 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:05:18.703851 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a075feff-9af3-4879-bd25-4ef641970c46 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:05:18.704213 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-a075feff-9af3-4879-bd25-4ef641970c46 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:05:18.891459 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-a075feff-9af3-4879-bd25-4ef641970c46 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:05:18.900035 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-a075feff-9af3-4879-bd25-4ef641970c46 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1566 microversion: 2.1 time: 0.210265 Aug 24 18:05:18.900591 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 606/1209] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:05:18 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1566 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:05:19.535073 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [req-e2b5ed92-0705-46b3-a3a2-dfe3e77a87c4 req-5d727b31-391c-4e43-ab45-5069b6914d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c9a68f-596d-421a-9bed-61eb25b228ba", "name": "network-vif-deleted", "tag": "039281e4-0f6b-49b6-9977-c41fac97b0ae"}]} {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 18:05:19.545598 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-e2b5ed92-0705-46b3-a3a2-dfe3e77a87c4 req-5d727b31-391c-4e43-ab45-5069b6914d37 service nova] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:05:19.547564 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-e2b5ed92-0705-46b3-a3a2-dfe3e77a87c4 req-5d727b31-391c-4e43-ab45-5069b6914d37 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:05:19.547564 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [req-e2b5ed92-0705-46b3-a3a2-dfe3e77a87c4 req-5d727b31-391c-4e43-ab45-5069b6914d37 service nova] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:05:19.557674 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.compute.server_external_events [req-e2b5ed92-0705-46b3-a3a2-dfe3e77a87c4 req-5d727b31-391c-4e43-ab45-5069b6914d37 service nova] Creating event network-vif-deleted:039281e4-0f6b-49b6-9977-c41fac97b0ae for instance 24c9a68f-596d-421a-9bed-61eb25b228ba on hv-cinder-85442 Aug 24 18:05:19.562806 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [req-e2b5ed92-0705-46b3-a3a2-dfe3e77a87c4 req-5d727b31-391c-4e43-ab45-5069b6914d37 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031635 Aug 24 18:05:19.563431 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 604/1210] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 18:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 18:05:19.920779 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-142b5f69-c956-4359-8bef-287424055bd6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:05:19.921426 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.compute.api [None req-142b5f69-c956-4359-8bef-287424055bd6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127677) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:05:19.928155 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-142b5f69-c956-4359-8bef-287424055bd6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:05:19.937461 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-142b5f69-c956-4359-8bef-287424055bd6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:05:19.937461 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-142b5f69-c956-4359-8bef-287424055bd6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:05:19.937461 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-142b5f69-c956-4359-8bef-287424055bd6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:05:19.937461 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-142b5f69-c956-4359-8bef-287424055bd6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:05:19.937986 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG oslo_concurrency.lockutils [None req-142b5f69-c956-4359-8bef-287424055bd6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:05:19.994258 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.policy [None req-142b5f69-c956-4359-8bef-287424055bd6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61b40f60c594f3299484e03ab34d19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a2ab43b0e64e888af68fc09725ef8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127677) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 18:05:20.002142 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-142b5f69-c956-4359-8bef-287424055bd6 tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 200 len: 1218 microversion: 2.1 time: 0.085202 Aug 24 18:05:20.005890 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 607/1211] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:05:19 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 18:05:21.024577 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5b8f2f20-2720-462c-9eeb-b57af3c4245a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '>' {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:05:21.025288 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.compute.api [None req-5b8f2f20-2720-462c-9eeb-b57af3c4245a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] [instance: 24c9a68f-596d-421a-9bed-61eb25b228ba] Fetching instance by UUID {{(pid=127676) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:05:21.031990 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b8f2f20-2720-462c-9eeb-b57af3c4245a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:05:21.032473 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b8f2f20-2720-462c-9eeb-b57af3c4245a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:05:21.032915 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b8f2f20-2720-462c-9eeb-b57af3c4245a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:05:21.033613 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b8f2f20-2720-462c-9eeb-b57af3c4245a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Acquiring lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:05:21.034117 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b8f2f20-2720-462c-9eeb-b57af3c4245a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:05:21.034547 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG oslo_concurrency.lockutils [None req-5b8f2f20-2720-462c-9eeb-b57af3c4245a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Lock "6269e10f-dbf4-40a1-8167-ac8cb84bb97a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:05:21.048515 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.wsgi [None req-5b8f2f20-2720-462c-9eeb-b57af3c4245a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] HTTP exception thrown: Instance 24c9a68f-596d-421a-9bed-61eb25b228ba could not be found. Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5b8f2f20-2720-462c-9eeb-b57af3c4245a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Request method failure captured: Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: request: GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba HTTP/1.1 Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept: application/json Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Accept-Encoding: identity Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Connection: close Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Length: 0 Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Content-Type: application/json Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Host: 10.222.0.76 Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Openstack-System-Scope: None Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: User-Agent: python-urllib3/1.26.11 Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Auth-Token: gAAAAABjBmdSO9AprNhT6Cd-jjLUa1FfL_TOKFZPmJ7VOgAQkTR7c5FZzIGerhkjGj5w2MFofO5GSJc95OdmBLw5O7kusTsvHwmNNcsKYHLZnsAdiGLPoEIsRwByfXhPe7wV9cIQLgMKUSAdaRgVFc6YLk1KNuf1AN9b4Yl-ZHVeofoKlvn7fa0 Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Id: None Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Domain-Name: None Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Identity-Status: Confirmed Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Is-Admin-Project: True Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Id: default Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Domain-Name: Default Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Id: 17a2ab43b0e64e888af68fc09725ef8d Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Project-Name: tempest-TestShelveInstance-141824699 Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Role: member,reader Aug 24 18:05:21.050163 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Roles: member,reader Aug 24 18:05:21.051719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/17a2ab43b0e64e888af68fc09725ef8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/17a2ab43b0e64e888af68fc09725ef8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_17a2ab43b0e64e888af68fc09725ef8d", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/17a2ab43b0e64e888af68fc09725ef8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] Aug 24 18:05:21.051719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant: tempest-TestShelveInstance-141824699 Aug 24 18:05:21.051719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Id: 17a2ab43b0e64e888af68fc09725ef8d Aug 24 18:05:21.051719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-Tenant-Name: tempest-TestShelveInstance-141824699 Aug 24 18:05:21.051719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User: tempest-TestShelveInstance-141824699-project Aug 24 18:05:21.051719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Id: default Aug 24 18:05:21.051719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Domain-Name: Default Aug 24 18:05:21.051719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Id: f61b40f60c594f3299484e03ab34d19b Aug 24 18:05:21.051719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: X-User-Name: tempest-TestShelveInstance-141824699-project Aug 24 18:05:21.051719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: method: > Aug 24 18:05:21.051719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: exception: Instance 24c9a68f-596d-421a-9bed-61eb25b228ba could not be found. Aug 24 18:05:21.051719 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: action_args: {'id': '24c9a68f-596d-421a-9bed-61eb25b228ba'} Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: {{(pid=127676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c9a68f-596d-421a-9bed-61eb25b228ba could not be found. Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 18:05:21.052642 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 18:05:21.054633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 18:05:21.054633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 18:05:21.054633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 18:05:21.054633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 18:05:21.054633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 18:05:21.054633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 18:05:21.054633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 18:05:21.054633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c9a68f-596d-421a-9bed-61eb25b228ba could not be found. Aug 24 18:05:21.054633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 18:05:21.054633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:05:21.054633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 18:05:21.054633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:05:21.054633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:05:21.054633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:05:21.054633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 18:05:21.054633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 18:05:21.054633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c9a68f-596d-421a-9bed-61eb25b228ba could not be found. Aug 24 18:05:21.054633 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: ERROR nova.api.openstack.wsgi Aug 24 18:05:21.056395 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: DEBUG nova.api.openstack.wsgi [None req-5b8f2f20-2720-462c-9eeb-b57af3c4245a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Returning 404 to user: Instance 24c9a68f-596d-421a-9bed-61eb25b228ba could not be found. {{(pid=127676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 18:05:21.056395 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO nova.api.openstack.requestlog [None req-5b8f2f20-2720-462c-9eeb-b57af3c4245a tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba" status: 404 len: 111 microversion: 2.1 time: 0.031823 Aug 24 18:05:21.056395 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: [pid: 127676|app: 0|req: 605/1212] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 18:05:21 2022] GET /compute/v2.1/servers/24c9a68f-596d-421a-9bed-61eb25b228ba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 18:05:21.262113 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: DEBUG nova.api.openstack.wsgi [None req-554f30fd-92d4-4794-bc60-42ae5def9b6e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] Calling method '.version_select at 0x7fce7752ea60>' {{(pid=127677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:05:21.332397 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO nova.api.openstack.requestlog [None req-554f30fd-92d4-4794-bc60-42ae5def9b6e tempest-TestShelveInstance-141824699 tempest-TestShelveInstance-141824699-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-265985228" status: 202 len: 0 microversion: 2.1 time: 0.074843 Aug 24 18:05:21.332975 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: [pid: 127677|app: 0|req: 608/1213] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 18:05:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-265985228 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 18:05:57.115897 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:05:57.116490 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Wed Aug 24 18:05:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:07:42.960523 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:07:42.961149 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Wed Aug 24 18:07:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:07:52.121658 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:07:52.122308 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Wed Aug 24 18:07:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:07:53.495185 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:07:53.495688 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Wed Aug 24 18:07:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:08:09.929958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:08:09.930430 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Wed Aug 24 18:08:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:09:17.124283 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:09:17.124958 dv-cinder-854428-1-iscsi devstack@n-api.service[127676]: Wed Aug 24 18:09:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:09:21.008418 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:09:21.008893 dv-cinder-854428-1-iscsi devstack@n-api.service[127677]: Wed Aug 24 18:09:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!